vm-test-run-nixbot-gitlab
default.checks.aarch64-linux.nixbot-gitlab
· build #233
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 46)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.LMpUYu3U1r', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13(finished: start all VMs, in 72.41 seconds)14gitlab # Discarding device blocks: 0/262144 done15gitlab: waiting for unit setup-gitlab.service16gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes17gitlab: waiting for the VM to finish booting18gitlab # Filesystem UUID: f8f8a416-d088-4cd7-87c9-0708f40d927819gitlab # Superblock backups stored on blocks:20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]31gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Thu Aug 6 17:27:09 UTC 202632gitlab # [ 0.000000] KASLR enabled33gitlab # [ 0.000000] random: crng init done34gitlab # [ 0.000000] Machine model: linux,dummy-virt35gitlab # [ 0.000000] efi: UEFI not found.36gitlab # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT37gitlab # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff]38gitlab # [ 0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf]39gitlab # [ 0.000000] Zone ranges:40gitlab # [ 0.000000] DMA [mem 0x0000000040000000-0x00000000ffffffff]41gitlab # [ 0.000000] DMA32 empty42gitlab # [ 0.000000] Normal [mem 0x0000000100000000-0x00000001bfffffff]43gitlab # [ 0.000000] Device empty44gitlab # [ 0.000000] Movable zone start for each node45gitlab # [ 0.000000] Early memory node ranges46gitlab # [ 0.000000] node 0: [mem 0x0000000040000000-0x00000001bfffffff]47gitlab # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff]48gitlab # [ 0.000000] cma: Reserved 32 MiB at 0x00000000fe00000049gitlab # [ 0.000000] psci: probing for conduit method from DT.50gitlab # [ 0.000000] psci: PSCIv1.3 detected in firmware.51gitlab # [ 0.000000] psci: Using standard PSCI v0.2 function IDs52gitlab # [ 0.000000] psci: Trusted OS migration not required53gitlab # [ 0.000000] psci: SMC Calling Convention v1.154gitlab # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)55gitlab # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u31129656gitlab # [ 0.000000] Detected PIPT I-cache on CPU057gitlab # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)58gitlab # [ 0.000000] CPU features: detected: GICv3 CPU interface59gitlab # [ 0.000000] CPU features: detected: Spectre-v460gitlab # [ 0.000000] CPU features: detected: Spectre-BHB61gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_3862gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_2363gitlab # [ 0.000000] alternatives: applying boot alternatives64gitlab # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/5nghy4m5v49pv8pfcj5qd5ai55jlcp71-nixos-system-gitlab-test/init regInfo=/nix/store/faw2mb976cf9989x7v9lxg73bv86x9y3-closure-info/registration console=ttyAMA0,115200n8 console=tty065gitlab # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/faw2mb976cf9989x7v9lxg73bv86x9y3-closure-info/registration", will be passed to user space.66gitlab # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes67gitlab # [ 0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)68gitlab # [ 0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)69gitlab # [ 0.000000] software IO TLB: area num 4.70gitlab # [ 0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB)71gitlab # [ 0.000000] Fallback order for Node 0: 072gitlab # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 157286473gitlab # [ 0.000000] Policy zone: Normal74gitlab # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off75gitlab # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=176gitlab # [ 0.000000] allocated 12582912 bytes of page_ext77gitlab # [ 0.000000] ftrace: allocating 74867 entries in 294 pages78gitlab # [ 0.000000] ftrace: allocated 294 pages with 4 groups79gitlab # [ 0.000000] rcu: Hierarchical RCU implementation.80gitlab # [ 0.000000] rcu: RCU event tracing is enabled.81gitlab # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.82gitlab # [ 0.000000] Trampoline variant of Tasks RCU enabled.83gitlab # [ 0.000000] Rude variant of Tasks RCU enabled.84gitlab # [ 0.000000] Tracing variant of Tasks RCU enabled.85gitlab # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.86gitlab # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=487gitlab # [ 0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.88gitlab # [ 0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.89gitlab # [ 0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.90gitlab # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 091gitlab # [ 0.000000] GICv3: 256 SPIs implemented92gitlab # [ 0.000000] GICv3: 0 Extended SPIs implemented93gitlab # [ 0.000000] Root IRQ handler: gic_handle_irq94gitlab # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI95gitlab # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=096gitlab # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a000097gitlab # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]98gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f10000 (indirect, esz 8, psz 64K, shr 1)99gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f20000 (flat, esz 8, psz 64K, shr 1)100gitlab # [ 0.000000] GICv3: using LPI property table @0x0000000100f30000101gitlab # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f40000102gitlab # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.103gitlab # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns104gitlab # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).105gitlab # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns106gitlab # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns107gitlab # [ 0.000028] arm-pv: using stolen time PV108gitlab # [ 0.000368] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)109gitlab # [ 0.000574] Console: colour dummy device 80x25110gitlab # [ 0.000581] printk: legacy console [tty0] enabled111gitlab # [ 0.000764] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)112gitlab # [ 0.000770] pid_max: default: 32768 minimum: 301113gitlab # [ 0.000847] LSM: initializing lsm=capability,landlock,yama,bpf,ima114gitlab # [ 0.000974] landlock: Up and running.115gitlab # [ 0.000977] Yama: becoming mindful.116gitlab # [ 0.001394] LSM support for eBPF active117gitlab # [ 0.001581] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)118gitlab # [ 0.001680] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)119gitlab # [ 0.002815] cacheinfo: Unable to detect cache hierarchy for CPU 0120gitlab # [ 0.003494] rcu: Hierarchical SRCU implementation.121gitlab # [ 0.003498] rcu: Max phase no-delay instances is 1000.122gitlab # [ 0.003645] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level123gitlab # [ 0.004627] fsl-mc MSI: its@8080000 domain created124gitlab # [ 0.004720] EFI services will not be available.125gitlab # [ 0.004889] smp: Bringing up secondary CPUs ...126gitlab # [ 0.005512] Detected PIPT I-cache on CPU1127gitlab # [ 0.005609] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000128gitlab # [ 0.005732] GICv3: CPU1: using allocated LPI pending table @0x0000000100f50000129gitlab # [ 0.005852] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40]130gitlab # [ 0.006963] Detected PIPT I-cache on CPU2131gitlab # [ 0.007069] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000132gitlab # [ 0.007191] GICv3: CPU2: using allocated LPI pending table @0x0000000100f60000133gitlab # [ 0.007333] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40]134gitlab # [ 0.008351] Detected PIPT I-cache on CPU3135gitlab # [ 0.008464] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000136gitlab # [ 0.008584] GICv3: CPU3: using allocated LPI pending table @0x0000000100f70000137gitlab # [ 0.008707] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40]138gitlab # [ 0.009215] smp: Brought up 1 node, 4 CPUs139gitlab # [ 0.009242] SMP: Total of 4 processors activated.140gitlab # [ 0.009244] CPU: All CPU(s) started at EL1141gitlab # [ 0.009254] CPU features: detected: Branch Target Identification142gitlab # [ 0.009258] CPU features: detected: ARMv8.4 Translation Table Level143gitlab # [ 0.009261] CPU features: detected: Instruction cache invalidation not required for I/D coherence144gitlab # [ 0.009264] CPU features: detected: Data cache clean to the PoU not required for I/D coherence145gitlab # [ 0.009267] CPU features: detected: Common not Private translations146gitlab # [ 0.009270] CPU features: detected: CRC32 instructions147gitlab # [ 0.009273] CPU features: detected: Data cache clean to Point of Deep Persistence148gitlab # [ 0.009276] CPU features: detected: Data cache clean to Point of Persistence149gitlab # [ 0.009279] CPU features: detected: Data independent timing control (DIT)150gitlab # [ 0.009281] CPU features: detected: E0PD151gitlab # [ 0.009283] CPU features: detected: Enhanced Counter Virtualization152gitlab # [ 0.009286] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)153gitlab # [ 0.009289] CPU features: detected: Enhanced Virtualization Traps154gitlab # [ 0.009292] CPU features: detected: Fine Grained Traps155gitlab # [ 0.009294] CPU features: detected: Generic authentication (architected QARMA5 algorithm)156gitlab # [ 0.009298] CPU features: detected: RCpc load-acquire (LDAPR)157gitlab # [ 0.009300] CPU features: detected: LSE atomic instructions158gitlab # [ 0.009303] CPU features: detected: Privileged Access Never159gitlab # [ 0.009305] CPU features: detected: PMUv3160gitlab # [ 0.009308] CPU features: detected: RAS Extension Support161gitlab # [ 0.009310] CPU features: detected: RASv1p1 Extension Support162gitlab # [ 0.009312] CPU features: detected: Random Number Generator163gitlab # [ 0.009315] CPU features: detected: Speculation barrier (SB)164gitlab # [ 0.009317] CPU features: detected: Stage-2 Force Write-Back165gitlab # [ 0.009320] CPU features: detected: TLB range maintenance instructions166gitlab # [ 0.009324] CPU features: detected: Speculative Store Bypassing Safe (SSBS)167gitlab # [ 0.009453] alternatives: applying system-wide alternatives168gitlab # [ 0.012288] CPU features: detected: BBM Level 2 without TLB conflict abort169gitlab # [ 0.012504] Memory: 5963780K/6291456K available (24448K kernel code, 7090K rwdata, 26340K rodata, 4736K init, 1106K bss, 272908K reserved, 32768K cma-reserved)170gitlab # [ 0.013925] devtmpfs: initialized171gitlab # [ 0.017816] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)172gitlab # [ 0.017878] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).173gitlab # [ 0.018068] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL174gitlab # [ 0.018073] 0 pages in range for non-PLT usage175gitlab # [ 0.018074] 508288 pages in range for PLT usage176gitlab # [ 0.018188] pinctrl core: initialized pinctrl subsystem177gitlab # [ 0.018961] DMI not present or invalid.178gitlab # [ 0.021987] NET: Registered PF_NETLINK/PF_ROUTE protocol family179gitlab # [ 0.024438] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations180gitlab # [ 0.024707] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations181gitlab # [ 0.026403] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations182gitlab # [ 0.026424] audit: initializing netlink subsys (disabled)183gitlab # [ 0.026732] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1184gitlab # [ 0.027141] thermal_sys: Registered thermal governor 'fair_share'185gitlab # [ 0.027144] thermal_sys: Registered thermal governor 'bang_bang'186gitlab # [ 0.027148] thermal_sys: Registered thermal governor 'step_wise'187gitlab # [ 0.027151] thermal_sys: Registered thermal governor 'user_space'188gitlab # [ 0.027153] thermal_sys: Registered thermal governor 'power_allocator'189gitlab # [ 0.027248] cpuidle: using governor ladder190gitlab # [ 0.027272] cpuidle: using governor menu191gitlab # [ 0.027465] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.192gitlab # [ 0.027686] ASID allocator initialised with 65536 entries193gitlab # [ 0.028762] Serial: AMBA PL011 UART driver194gitlab # [ 0.033847] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1195gitlab # [ 0.034163] printk: console [ttyAMA0] enabled196gitlab # [ 0.050337] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages197gitlab # [ 0.050343] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page198gitlab # [ 0.050347] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages199gitlab # [ 0.050349] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page200gitlab # [ 0.050352] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages201gitlab # [ 0.050355] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page202gitlab # [ 0.050358] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages203gitlab # [ 0.050360] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page204gitlab # [ 0.062027] fbcon: Taking over console205gitlab # [ 0.062056] ACPI: Interpreter disabled.206gitlab # [ 0.064580] iommu: Default domain type: Translated207gitlab # [ 0.064591] iommu: DMA domain TLB invalidation policy: strict mode208gitlab # [ 0.090544] SCSI subsystem initialized209gitlab # [ 0.091202] usbcore: registered new interface driver usbfs210gitlab # [ 0.091253] usbcore: registered new interface driver hub211gitlab # [ 0.091278] usbcore: registered new device driver usb212gitlab # [ 0.091739] pps_core: LinuxPPS API ver. 1 registered213gitlab # [ 0.091744] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>214gitlab # [ 0.091757] PTP clock support registered215gitlab # [ 0.091816] EDAC MC: Ver: 3.0.0216gitlab # [ 0.092290] scmi_core: SCMI protocol bus registered217gitlab # [ 0.093068] FPGA manager framework218gitlab # [ 0.093874] vgaarb: loaded219gitlab # [ 0.095429] clocksource: Switched to clocksource arch_sys_counter220gitlab # [ 0.096153] VFS: Disk quotas dquot_6.6.0221gitlab # [ 0.096190] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)222gitlab # [ 0.097396] netfs: FS-Cache loaded223gitlab # [ 0.098029] pnp: PnP ACPI: disabled224gitlab # [ 0.106786] NET: Registered PF_INET protocol family225gitlab # [ 0.108125] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)226gitlab # [ 0.146146] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)227gitlab # [ 0.146202] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)228gitlab # [ 0.146252] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)229gitlab # [ 0.146570] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)230gitlab # [ 0.147257] TCP: Hash tables configured (established 65536 bind 65536)231gitlab # [ 0.147358] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)232gitlab # [ 0.147417] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)233gitlab # [ 0.147589] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)234gitlab # [ 0.147806] NET: Registered PF_UNIX/PF_LOCAL protocol family235gitlab # [ 0.147829] NET: Registered PF_XDP protocol family236gitlab # [ 0.147845] PCI: CLS 0 bytes, default 64237gitlab # [ 0.148166] Trying to unpack rootfs image as initramfs...238gitlab # [ 0.152189] kvm [1]: HYP mode not available239gitlab # [ 0.202941] Initialise system trusted keyrings240gitlab # [ 0.203164] workingset: timestamp_bits=42 max_order=21 bucket_order=0241gitlab # [ 0.203746] squashfs: version 4.0 (2009/01/31) Phillip Lougher242gitlab # [ 0.203866] 9p: Installing v9fs 9p2000 file system support243gitlab # [ 0.215799] Key type asymmetric registered244gitlab # [ 0.215804] Asymmetric key parser 'x509' registered245gitlab # [ 0.215844] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)246gitlab # [ 0.216038] io scheduler mq-deadline registered247gitlab # [ 0.216042] io scheduler kyber registered248gitlab # [ 0.227758] pl061_gpio 9030000.pl061: PL061 GPIO chip registered249gitlab # [ 0.232131] ledtrig-cpu: registered to indicate activity on CPUs250gitlab # [ 0.232562] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:251gitlab # [ 0.232577] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000252gitlab # [ 0.232589] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000253gitlab # [ 0.232597] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000254gitlab # [ 0.232617] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits255gitlab # [ 0.232640] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]256gitlab # [ 0.232727] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00257gitlab # [ 0.232736] pci_bus 0000:00: root bus resource [bus 00-ff]258gitlab # [ 0.232741] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]259gitlab # [ 0.232745] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]260gitlab # [ 0.232748] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]261gitlab # [ 0.232823] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint262gitlab # [ 0.233514] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint263gitlab # [ 0.233832] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]264gitlab # [ 0.233848] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]265gitlab # [ 0.233883] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]266gitlab # [ 0.233905] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]267gitlab # [ 0.234694] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint268gitlab # [ 0.235046] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]269gitlab # [ 0.235060] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]270gitlab # [ 0.235107] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]271gitlab # [ 0.235763] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint272gitlab # [ 0.236051] pci 0000:00:03.0: BAR 0 [io 0x0000-0x001f]273gitlab # [ 0.236065] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]274gitlab # [ 0.236098] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]275gitlab # [ 0.236774] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint276gitlab # [ 0.237052] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]277gitlab # [ 0.237066] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]278gitlab # [ 0.237106] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]279gitlab # [ 0.237789] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint280gitlab # [ 0.238085] pci 0000:00:05.0: BAR 0 [io 0x0000-0x007f]281gitlab # [ 0.238100] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]282gitlab # [ 0.238138] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]283gitlab # [ 0.238843] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint284gitlab # [ 0.239110] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]285gitlab # [ 0.239124] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]286gitlab # [ 0.239157] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]287gitlab # [ 0.239881] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint288gitlab # [ 0.240156] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]289gitlab # [ 0.240170] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]290gitlab # [ 0.240203] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]291gitlab # [ 0.240217] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]292gitlab # [ 0.240934] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint293gitlab # [ 0.241197] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]294gitlab # [ 0.241235] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]295gitlab # [ 0.241898] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint296gitlab # [ 0.242186] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]297gitlab # [ 0.242218] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]298gitlab # [ 0.242793] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint299gitlab # [ 0.243091] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]300gitlab # [ 0.243461] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint301gitlab # [ 0.243854] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]302gitlab # [ 0.243870] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]303gitlab # [ 0.243902] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]304gitlab # [ 0.244570] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint305gitlab # [ 0.244845] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]306gitlab # [ 0.244859] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]307gitlab # [ 0.244890] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]308gitlab # [ 0.245704] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned309gitlab # [ 0.245712] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned310gitlab # [ 0.245716] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned311gitlab # [ 0.245768] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned312gitlab # [ 0.245827] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned313gitlab # [ 0.245894] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned314gitlab # [ 0.245946] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned315gitlab # [ 0.246011] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned316gitlab # [ 0.246078] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned317gitlab # [ 0.246136] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned318gitlab # [ 0.246187] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned319gitlab # [ 0.246245] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned320gitlab # [ 0.246310] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned321gitlab # [ 0.246377] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned322gitlab # [ 0.246403] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned323gitlab # [ 0.246424] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned324gitlab # [ 0.246451] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned325gitlab # [ 0.246472] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned326gitlab # [ 0.246499] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned327gitlab # [ 0.246520] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned328gitlab # [ 0.246546] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned329gitlab # [ 0.246568] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned330gitlab # [ 0.246590] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned331gitlab # [ 0.246612] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned332gitlab # [ 0.246633] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned333gitlab # [ 0.246660] pci 0000:00:05.0: BAR 0 [io 0x1000-0x107f]: assigned334gitlab # [ 0.246686] pci 0000:00:06.0: BAR 0 [io 0x1080-0x10ff]: assigned335gitlab # [ 0.246706] pci 0000:00:0b.0: BAR 0 [io 0x1100-0x113f]: assigned336gitlab # [ 0.246727] pci 0000:00:01.0: BAR 0 [io 0x1140-0x115f]: assigned337gitlab # [ 0.246747] pci 0000:00:02.0: BAR 0 [io 0x1160-0x117f]: assigned338gitlab # [ 0.246768] pci 0000:00:03.0: BAR 0 [io 0x1180-0x119f]: assigned339gitlab # [ 0.246795] pci 0000:00:04.0: BAR 0 [io 0x11a0-0x11bf]: assigned340gitlab # [ 0.246816] pci 0000:00:07.0: BAR 0 [io 0x11c0-0x11df]: assigned341gitlab # [ 0.246843] pci 0000:00:0c.0: BAR 0 [io 0x11e0-0x11ff]: assigned342gitlab # [ 0.246868] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]343gitlab # [ 0.246874] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]344gitlab # [ 0.246878] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]345gitlab # [ 0.248660] pci 0000:00:0a.0: enabling device (0000 -> 0002)346gitlab # [ 0.262716] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)347gitlab # [ 0.265162] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)348gitlab # [ 0.267712] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)349gitlab # [ 0.270040] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)350gitlab # [ 0.272358] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)351gitlab # [ 0.277469] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)352gitlab # [ 0.279696] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)353gitlab # [ 0.282121] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)354gitlab # [ 0.284403] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)355gitlab # [ 0.286444] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)356gitlab # [ 0.292526] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)357gitlab # [ 0.299097] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled358gitlab # [ 0.301044] msm_serial: driver initialized359gitlab # [ 0.301202] SuperH (H)SCI(F) driver initialized360gitlab # [ 0.301259] STM32 USART driver initialized361gitlab # [ 0.320501] loop: module loaded362gitlab # [ 0.320699] virtio_blk virtio4: 4/0/0 default/read/poll queues363gitlab # [ 0.322494] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)364gitlab # [ 0.324372] virtio_blk virtio5: 4/0/0 default/read/poll queues365gitlab # [ 0.326089] virtio_blk virtio5: [vdb] 12227512 512-byte logical blocks (6.26 GB/5.83 GiB)366gitlab # [ 0.328169] megasas: 07.734.00.00-rc1367gitlab # [ 0.328858] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]368gitlab # [ 0.332741] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000369gitlab # [ 0.332757] Intel/Sharp Extended Query Table at 0x0031370gitlab # [ 0.334342] Using buffer write method371gitlab # [ 0.334377] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]372gitlab # [ 0.336108] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000373gitlab # [ 0.336125] Intel/Sharp Extended Query Table at 0x0031374gitlab # [ 0.337698] Using buffer write method375gitlab # [ 0.337714] Concatenating MTD devices:376gitlab # [ 0.337716] (0): "0.flash"377gitlab # [ 0.337718] (1): "0.flash"378gitlab # [ 0.337720] into device "0.flash"379gitlab # [ 0.596217] Freeing initrd memory: 27184K380gitlab # [ 0.609651] tun: Universal TUN/TAP device driver, 1.6381gitlab # [ 0.613485] thunder_xcv, ver 1.0382gitlab # [ 0.613524] thunder_bgx, ver 1.0383gitlab # [ 0.613546] nicpf, ver 1.0384gitlab # [ 0.614086] e1000: Intel(R) PRO/1000 Network Driver385gitlab # [ 0.614090] e1000: Copyright (c) 1999-2006 Intel Corporation.386gitlab # [ 0.614116] e1000e: Intel(R) PRO/1000 Network Driver387gitlab # [ 0.614121] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.388gitlab # [ 0.614144] igb: Intel(R) Gigabit Ethernet Network Driver389gitlab # [ 0.614147] igb: Copyright (c) 2007-2014 Intel Corporation.390gitlab # [ 0.614166] igbvf: Intel(R) Gigabit Virtual Function Network Driver391gitlab # [ 0.614169] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.392gitlab # [ 0.614312] sky2: driver version 1.30393gitlab # [ 0.615909] usbcore: registered new interface driver usb-storage394gitlab # [ 0.616000] usbcore: registered new interface driver usbserial_generic395gitlab # [ 0.616014] usbserial: USB Serial support registered for generic396gitlab # [ 0.616601] hv_vmbus: registering driver hyperv_keyboard397gitlab # [ 0.617281] ehci-pci 0000:00:0a.0: EHCI Host Controller398gitlab # [ 0.617357] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1399gitlab # [ 0.617717] rtc-pl031 9010000.pl031: registered as rtc0400gitlab # [ 0.617744] rtc-pl031 9010000.pl031: setting system clock to 2026-08-16T16:42:39 UTC (1786898559)401gitlab # [ 0.618038] i2c_dev: i2c /dev entries driver402gitlab # [ 0.618160] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000403gitlab # [ 0.620852] sdhci: Secure Digital Host Controller Interface driver404gitlab # [ 0.620859] sdhci: Copyright(c) Pierre Ossman405gitlab # [ 0.621118] Synopsys Designware Multimedia Card Interface Driver406gitlab # [ 0.621486] sdhci-pltfm: SDHCI platform and OF driver helper407gitlab # [ 0.623094] hid: raw HID events driver (C) Jiri Kosina408gitlab # [ 0.623365] usbcore: registered new interface driver usbhid409gitlab # [ 0.623369] usbhid: USB HID core driver410gitlab # [ 0.643500] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00411gitlab # [ 0.643975] hub 1-0:1.0: USB hub found412gitlab # [ 0.643994] hub 1-0:1.0: 6 ports detected413gitlab # [ 0.649986] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available414gitlab # [ 0.654725] drop_monitor: Initializing network drop monitor service415gitlab # [ 0.655127] NET: Registered PF_INET6 protocol family416gitlab # [ 0.656922] Segment Routing with IPv6417gitlab # [ 0.656943] In-situ OAM (IOAM) with IPv6418gitlab # [ 0.656988] NET: Registered PF_PACKET protocol family419gitlab # [ 0.657192] 9pnet: Installing 9P2000 support420gitlab # [ 0.659465] Key type dns_resolver registered421gitlab # [ 0.668536] registered taskstats version 1422gitlab # [ 0.668732] Loading compiled-in X.509 certificates423gitlab # [ 0.679495] Demotion targets for Node 0: null424gitlab # [ 0.679700] Key type .fscrypt registered425gitlab # [ 0.679705] Key type fscrypt-provisioning registered426gitlab # [ 0.679816] ima: No TPM chip found, activating TPM-bypass!427gitlab # [ 0.679834] ima: Allocated hash algorithm: sha1428gitlab # [ 0.679858] ima: No architecture policies found429gitlab # [ 0.680668] input: gpio-keys as /devices/platform/gpio-keys/input/input0430gitlab # [ 0.701532] clk: Disabling unused clocks431gitlab # [ 0.701559] PM: genpd: Disabling unused power domains432gitlab # [ 0.705209] Freeing unused kernel memory: 4736K433gitlab # [ 0.705420] Run /init as init process434gitlab # [ 0.732872] systemd[1]: Successfully made /usr/ read-only.435gitlab # [ 0.891547] usb 1-1: new high-speed USB device number 2 using ehci-pci436gitlab # [ 1.043691] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1437gitlab # [ 1.067201] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)438gitlab # [ 1.067280] systemd[1]: Detected virtualization qemu.439gitlab # [ 1.067351] systemd[1]: Detected architecture arm64.440gitlab # [ 1.067366] systemd[1]: Running in initrd.441gitlab # [ 1.068250] systemd[1]: Initializing machine ID from random generator.442gitlab # [ 1.068592] systemd[1]: Hostname set to <gitlab>.443gitlab # [ 1.183641] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0444gitlab # [ 1.307541] usb 1-2: new high-speed USB device number 3 using ehci-pci445gitlab # [ 1.414197] systemd[1]: bpf-restrict-fs: LSM BPF program attached446gitlab # [ 1.473813] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2447gitlab # [ 1.474647] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0448gitlab # [ 1.570861] systemd[1]: Queued start job for default target Initrd Default Target.449gitlab # [ 1.593438] systemd[1]: Created slice Slice /system/modprobe.450gitlab # [ 1.593964] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.451gitlab # [ 1.594021] systemd[1]: Expecting device /dev/disk/by-label/nix-store...452gitlab # [ 1.594093] systemd[1]: Expecting device /dev/disk/by-label/nixos...453gitlab # [ 1.594151] systemd[1]: Reached target Path Units.454gitlab # [ 1.594181] systemd[1]: Reached target Slice Units.455gitlab # [ 1.594205] systemd[1]: Reached target Swaps.456gitlab # [ 1.594228] systemd[1]: Reached target Timer Units.457gitlab # [ 1.594858] systemd[1]: Listening on D-Bus System Message Bus Socket.458gitlab # [ 1.595335] systemd[1]: Listening on Journal Socket (/dev/log).459gitlab # [ 1.595622] systemd[1]: Listening on Journal Sockets.460gitlab # [ 1.595930] systemd[1]: Listening on udev Control Socket.461gitlab # [ 1.596078] systemd[1]: Listening on udev Kernel Socket.462gitlab # [ 1.596110] systemd[1]: Reached target Socket Units.463gitlab # [ 1.600172] systemd[1]: Starting Create List of Static Device Nodes...464gitlab # [ 1.603418] systemd[1]: Starting Load Kernel Module 9pnet_virtio...465gitlab # [ 1.603619] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs466gitlab # [ 1.607178] systemd[1]: Mounting Kernel Configuration File System...467gitlab # [ 1.639797] systemd[1]: Starting Journal Service...468gitlab # [ 1.650250] systemd[1]: Starting Load Kernel Modules...469gitlab # [ 1.650566] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os470gitlab # [ 1.655741] systemd[1]: Starting Coldplug All udev Devices...471gitlab # [ 1.661350] systemd[1]: Finished Create List of Static Device Nodes.472gitlab # [ 1.664668] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.473gitlab # [ 1.665959] systemd[1]: Finished Load Kernel Module 9pnet_virtio.474gitlab # [ 1.666803] systemd[1]: Mounted Kernel Configuration File System.475gitlab # [ 1.672664] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...476gitlab # [ 1.685575] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0477gitlab # [ 1.685798] [drm] features: -virgl +edid -resource_blob -host_visible478gitlab # [ 1.685807] [drm] features: -context_init479gitlab # [ 1.687039] [drm] number of scanouts: 1480gitlab # [ 1.687062] [drm] number of cap sets: 0481gitlab # [ 1.696456] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.482gitlab # [ 1.697168] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic483gitlab # [ 1.697177] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0484gitlab # [ 1.703706] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev485gitlab # [ 1.704911] Console: switching to colour frame buffer device 160x50486gitlab # [ 1.709741] systemd-journald[95]: Collecting audit messages is disabled.487gitlab # [ 1.711079] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device488gitlab # [ 1.711893] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.489gitlab # [ 1.715986] systemd[1]: Starting Create Static Device Nodes in /dev...490gitlab # [ 1.732553] systemd[1]: Finished Load Kernel Modules.491gitlab # [ 1.743746] systemd[1]: Starting Apply Kernel Variables...492gitlab # [ 1.754980] systemd[1]: Finished Create Static Device Nodes in /dev.493gitlab # [ 1.755741] systemd[1]: Reached target Preparation for Local File Systems.494gitlab # [ 1.756338] systemd[1]: Reached target Local File Systems.495gitlab # [ 1.767906] systemd[1]: Starting Rule-based Manager for Device Events and Files...496gitlab # [ 1.787779] systemd[1]: Finished Apply Kernel Variables.497gitlab # [ 1.792582] systemd[1]: Started Journal Service.498gitlab # [ 1.789094] systemd-modules-load[96]: Using 4 probe threads499gitlab # [ 1.792485] systemd-modules-load[96]: Module 'virtio_balloon' is built in500gitlab # [ 1.793590] systemd-modules-load[96]: Module 'virtio_console' is built in501gitlab # [ 1.794639] systemd-modules-load[96]: Module 'virtio_rng' is built in502gitlab # [ 1.795622] systemd-modules-load[96]: Inserted module 'dm_mod'503gitlab # [ 1.796763] systemd-modules-load[96]: Inserted module 'virtio_gpu'504gitlab # [ 1.803361] systemd[1]: Starting Create System Files and Directories...505gitlab # [ 1.810241] systemd-udevd[106]: Using default interface naming scheme 'v261'.506gitlab # [ 1.832105] systemd[1]: Started Rule-based Manager for Device Events and Files.507gitlab # [ 1.858879] systemd[1]: Finished Create System Files and Directories.508gitlab # [ 1.866538] systemd[1]: Starting Virtual Console Setup...509gitlab # [ 1.952838] systemd-vconsole-setup[128]: Configuration of first virtual console was skipped, ignoring remaining ones.510gitlab # [ 1.958234] systemd[1]: Finished Virtual Console Setup.511gitlab # [ 2.436955] systemd[1]: Finished Coldplug All udev Devices.512gitlab # [ 2.439813] systemd[1]: Reached target System Initialization.513gitlab # [ 2.442498] systemd[1]: Reached target Basic System.514gitlab # [ 2.690736] (udev-worker)[121]: Network interface NamePolicy= disabled on kernel command line.515gitlab # [ 2.716401] (udev-worker)[117]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.516gitlab # [ 2.720769] systemd[1]: Found device /dev/disk/by-label/nixos.517gitlab # [ 2.722727] (udev-worker)[117]: Network interface NamePolicy= disabled on kernel command line.518gitlab # [ 2.726471] systemd[1]: Reached target Initrd Root Device.519gitlab # [ 2.728158] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...520gitlab # [ 2.771998] systemd[1]: Found device /dev/disk/by-label/nix-store.521gitlab # [ 2.775770] systemd-fsck[151]: nixos: clean, 12/65536 files, 13019/262144 blocks522gitlab # [ 2.780001] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.523gitlab # [ 2.781617] systemd[1]: Mounting /sysroot...524gitlab # [ 2.860811] EXT4-fs (vda): mounted filesystem f8f8a416-d088-4cd7-87c9-0708f40d9278 r/w with ordered data mode. Quota mode: none.525gitlab # [ 2.863090] systemd[1]: Mounted /sysroot.526gitlab # [ 2.864148] systemd[1]: Reached target Initrd Root File System.527gitlab # [ 2.867979] systemd[1]: Mounting /sysroot/nix/.ro-store...528gitlab # [ 2.869313] systemd[1]: Mounting /sysroot/nix/.rw-store...529gitlab # [ 2.873358] systemd[1]: Mounting /sysroot/run...530gitlab # [ 2.904248] systemd[1]: Mounting /sysroot/tmp/shared...531gitlab # [ 2.907215] systemd[1]: Mounting /sysroot/tmp/xchg...532gitlab # [ 2.925204] systemd[1]: Starting Mountpoints Configured in the Real Root...533gitlab # [ 2.940686] systemd[1]: Mounted /sysroot/nix/.rw-store.534gitlab # [ 2.943304] systemd[1]: Mounted /sysroot/run.535gitlab # [ 2.957206] systemd-sysroot-fstab-check[166]: /sysroot should be mounted in the initrd, will request daemon-reload.536gitlab # [ 2.967075] systemd[1]: Starting rw-sysroot-nix-store.service...537gitlab # [ 2.971273] systemd[1]: Reload requested from client PID 166 ('systemd-sysroot') (unit initrd-parse-etc.service)...538gitlab # [ 2.972976] systemd[1]: Reloading...539gitlab # [ 3.236088] erofs (device vdb): mounted with root inode @ nid 128.540gitlab # [ 3.307029] systemd[1]: Reloading finished in 335 ms.541gitlab # [ 3.380718] systemd-sysroot-fstab-check[166]: Requesting initrd-fs.target/start/replace...542gitlab # [ 3.384770] systemd[1]: Mounted /sysroot/nix/.ro-store.543gitlab # [ 3.385579] systemd[1]: Mounted /sysroot/tmp/shared.544gitlab # [ 3.386307] systemd[1]: Mounted /sysroot/tmp/xchg.545gitlab # [ 3.387006] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.546gitlab # [ 3.388378] systemd[1]: Finished rw-sysroot-nix-store.service.547gitlab # [ 3.389680] systemd-sysroot-fstab-check[166]: Requesting swap.target/start/replace...548gitlab # [ 3.393900] systemd[1]: initrd-parse-etc.service: Deactivated successfully.549gitlab # [ 3.395488] systemd[1]: Finished Mountpoints Configured in the Real Root.550gitlab # [ 3.396690] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.551gitlab # [ 3.402202] systemd[1]: Starting rw-sysroot-nix-store.service...552gitlab # [ 3.427494] (udev-worker)[120]: mtd0ro: Failed to find and pin callout binary "/nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/mtd_probe": No such file or directory553gitlab # [ 3.430467] (udev-worker)[120]: mtd0ro: /nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory554gitlab # [ 3.435014] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.555gitlab # [ 3.436366] systemd[1]: Finished rw-sysroot-nix-store.service.556gitlab # [ 3.437194] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.557gitlab # [ 3.438213] systemd[1]: Stopped Virtual Console Setup.558gitlab # [ 3.438940] systemd[1]: Stopping Virtual Console Setup...559gitlab # [ 3.439694] systemd[1]: Starting Virtual Console Setup...560gitlab # [ 3.444777] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.561gitlab # [ 3.445834] systemd[1]: Stopped Virtual Console Setup.562gitlab # [ 3.447145] systemd[1]: Starting Virtual Console Setup...563gitlab # [ 3.508361] systemd-vconsole-setup[199]: Configuration of first virtual console was skipped, ignoring remaining ones.564gitlab # [ 3.511720] systemd[1]: Finished Virtual Console Setup.565gitlab # [ 3.661199] systemd[1]: Mounting /sysroot/nix/store...566gitlab # [ 3.730320] systemd[1]: Mounted /sysroot/nix/store.567gitlab # [ 3.732664] systemd[1]: Reached target Initrd File Systems.568gitlab # [ 3.735034] systemd[1]: Starting Find NixOS closure...569gitlab # [ 3.737678] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...570gitlab # [ 3.783894] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.571gitlab # [ 3.787389] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.572gitlab # [ 3.804722] systemd[1]: Finished Find NixOS closure.573gitlab # [ 3.807032] systemd[1]: Reached target Initrd Default Target.574gitlab # [ 3.809680] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...575gitlab # [ 3.855590] systemd[1]: Stopped target Initrd Default Target.576gitlab # [ 3.858243] systemd[1]: Stopped target Basic System.577gitlab # [ 3.860484] systemd[1]: Stopped target Initrd Root Device.578gitlab # [ 3.862814] systemd[1]: Stopped target Path Units.579gitlab # [ 3.865040] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.580gitlab # [ 3.868207] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.581gitlab # [ 3.871407] systemd[1]: Stopped target Slice Units.582gitlab # [ 3.873692] systemd[1]: Stopped target Socket Units.583gitlab # [ 3.877501] systemd[1]: Stopped target System Initialization.584gitlab # [ 3.881343] systemd[1]: Stopped target Swaps.585gitlab # [ 3.885028] systemd[1]: Stopped target Timer Units.586gitlab # [ 3.890174] systemd[1]: dbus.socket: Deactivated successfully.587gitlab # [ 3.895322] systemd[1]: Closed D-Bus System Message Bus Socket.588gitlab # [ 3.899073] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.589gitlab # [ 3.902790] systemd[1]: Stopped Find NixOS closure.590gitlab # [ 3.904927] systemd[1]: Starting Load Kernel Module 9pnet_virtio...591gitlab # [ 3.907482] systemd[1]: Starting rw-sysroot-nix-store.service...592gitlab # [ 3.910374] systemd[1]: systemd-sysctl.service: Deactivated successfully.593gitlab # [ 3.912963] systemd[1]: Stopped Apply Kernel Variables.594gitlab # [ 3.915021] systemd[1]: systemd-modules-load.service: Deactivated successfully.595gitlab # [ 3.917846] systemd[1]: Stopped Load Kernel Modules.596gitlab # [ 3.919692] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.597gitlab # [ 3.922659] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.598gitlab # [ 3.925383] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.599gitlab # [ 3.927726] systemd[1]: Stopped Create System Files and Directories.600gitlab # [ 3.929872] systemd[1]: Stopped target Local File Systems.601gitlab # [ 3.931553] systemd[1]: Stopped target Preparation for Local File Systems.602gitlab # [ 3.933757] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.603gitlab # [ 3.935969] systemd[1]: Stopped Coldplug All udev Devices.604gitlab # [ 3.937793] systemd[1]: Stopping Rule-based Manager for Device Events and Files...605gitlab # [ 3.939908] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.606gitlab # [ 3.942101] systemd[1]: Stopped Virtual Console Setup.607gitlab # [ 3.943515] systemd[1]: initrd-cleanup.service: Deactivated successfully.608gitlab # [ 3.945352] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.609gitlab # [ 3.947013] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.610gitlab # [ 3.948856] systemd[1]: Finished rw-sysroot-nix-store.service.611gitlab # [ 3.950262] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.612gitlab # [ 3.951988] systemd[1]: Finished Load Kernel Module 9pnet_virtio.613gitlab # [ 3.954320] systemd[1]: systemd-udevd.service: Deactivated successfully.614gitlab # [ 3.955811] systemd[1]: Stopped Rule-based Manager for Device Events and Files.615gitlab # [ 3.957635] systemd[1]: systemd-udevd.service: Consumed 2.762s CPU time over 2.153s wall clock time, 31.6M memory peak.616gitlab # [ 3.959927] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.617gitlab # [ 3.961670] systemd[1]: Closed udev Control Socket.618gitlab # [ 3.962816] systemd[1]: Starting Cleanup udev Database...619gitlab # [ 3.964088] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.620gitlab # [ 3.965814] systemd[1]: Stopped Create Static Device Nodes in /dev.621gitlab # [ 3.967224] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.622gitlab # [ 3.969128] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.623gitlab # [ 3.970725] systemd[1]: kmod-static-nodes.service: Deactivated successfully.624gitlab # [ 3.972326] systemd[1]: Stopped Create List of Static Device Nodes.625gitlab # [ 4.014140] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.626gitlab # [ 4.017547] systemd[1]: Finished Cleanup udev Database.627gitlab # [ 4.019856] systemd[1]: Reached target Switch Root.628gitlab # [ 4.022177] systemd[1]: Starting NixOS Activation...629gitlab # [ 4.224698] initrd-nixos-activation-start[224]: booting system configuration /nix/store/5nghy4m5v49pv8pfcj5qd5ai55jlcp71-nixos-system-gitlab-test630gitlab # [ 4.284835] initrd-nixos-activation-start[224]: running activation script...631gitlab # [ 4.599872] initrd-nixos-activation-start[247]: setting up /etc...632gitlab # [ 4.781267] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.633gitlab # [ 4.784772] systemd[1]: Finished NixOS Activation.634gitlab # [ 4.786929] systemd[1]: Starting Switch Root...635gitlab # [ 4.855538] systemd[1]: Switching root.636gitlab # [ 4.975854] systemd-journald[95]: Received SIGTERM from PID 1 (systemd).637gitlab # [ 5.604124] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)638gitlab # [ 5.604255] systemd[1]: Detected virtualization qemu.639gitlab # [ 5.604330] systemd[1]: Detected architecture arm64.640gitlab # [ 5.604496] systemd[1]: Detected first boot.641gitlab # [ 5.605835] systemd[1]: Initializing machine ID from random generator.642gitlab # [ 5.906039] systemd[1]: bpf-restrict-fs: LSM BPF program attached643gitlab # [ 6.029249] systemd[1]: Applying preset policy.644gitlab # [ 6.235264] systemd[1]: Populated /etc with preset unit settings.645gitlab # [ 6.385821] systemd[1]: initrd-switch-root.service: Deactivated successfully.646gitlab # [ 6.386594] systemd[1]: Stopped initrd-switch-root.service.647gitlab # [ 6.388438] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.648gitlab # [ 6.396181] systemd[1]: Created slice Slice /system/getty.649gitlab # [ 6.399983] systemd[1]: Created slice GitLab DevOps Platform Slice.650gitlab # [ 6.404020] systemd[1]: Created slice User and Session Slice.651gitlab # [ 6.405319] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.652gitlab # [ 6.406648] systemd[1]: Started Forward Password Requests to Wall Directory Watch.653gitlab # [ 6.407809] systemd[1]: Expecting device /dev/hvc0...654gitlab # [ 6.408792] systemd[1]: Expecting device /dev/ttyAMA0...655gitlab # [ 6.409794] systemd[1]: Reached target Local Encrypted Volumes.656gitlab # [ 6.410841] systemd[1]: Stopped target initrd-fs.target.657gitlab # [ 6.411917] systemd[1]: Stopped target initrd-root-fs.target.658gitlab # [ 6.412940] systemd[1]: Stopped target initrd-switch-root.target.659gitlab # [ 6.413999] systemd[1]: Reached target Virtual Machines and Containers.660gitlab # [ 6.415087] systemd[1]: Reached target Path Units.661gitlab # [ 6.416945] systemd[1]: Reached target Remote File Systems.662gitlab # [ 6.417952] systemd[1]: Reached target Slice Units.663gitlab # [ 6.418978] systemd[1]: Reached target Swaps.664gitlab # [ 6.421271] systemd[1]: Listening on Query the User Interactively for a Password.665gitlab # [ 6.423045] systemd[1]: Listening on Process Core Dump Socket.666gitlab # [ 6.424488] systemd[1]: Listening on Credential Encryption/Decryption.667gitlab # [ 6.426148] systemd[1]: Listening on Factory Reset Management.668gitlab # [ 6.426804] systemd[1]: Listening on Hostname Service Socket.669gitlab # [ 6.434022] systemd[1]: Starting Journal Log Access Socket...670gitlab # [ 6.435525] systemd[1]: Listening on Journal Audit Socket.671gitlab # [ 6.439914] systemd[1]: Listening on Console Output Muting Service Socket.672gitlab # [ 6.441590] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.673gitlab # [ 6.442739] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os674gitlab # [ 6.443846] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki675gitlab # [ 6.450063] systemd[1]: Listening on Disk Repartitioning Service Socket.676gitlab # [ 6.451488] systemd[1]: Listening on udev Control Socket.677gitlab # [ 6.452907] systemd[1]: Listening on udev Varlink Socket.678gitlab # [ 6.500005] systemd[1]: Mounting Huge Pages File System...679gitlab # [ 6.506147] systemd[1]: Mounting POSIX Message Queue File System...680gitlab # [ 6.511853] systemd[1]: Mounting Kernel Debug File System...681gitlab # [ 6.517442] systemd[1]: Mounting Kernel Trace File System...682gitlab # [ 6.523073] systemd[1]: Starting Create List of Static Device Nodes...683gitlab # [ 6.532303] systemd[1]: Starting Load Kernel Module 9pnet_virtio...684gitlab # [ 6.533818] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs685gitlab # [ 6.551708] systemd[1]: Mounting Kernel Configuration File System...686gitlab # [ 6.552686] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm687gitlab # [ 6.553609] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore688gitlab # [ 6.573776] systemd[1]: Starting Load Kernel Module fuse...689gitlab # [ 6.575190] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67690gitlab # [ 6.586089] systemd[1]: Starting Journal Service...691gitlab # [ 6.590229] systemd[1]: Starting Load Kernel Modules...692gitlab # [ 6.599781] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...693gitlab # [ 6.611308] fuse: init (API version 7.45)694gitlab # [ 6.613851] systemd[1]: Starting Remount Root and Kernel File Systems...695gitlab # [ 6.614450] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os696gitlab # [ 6.630723] systemd[1]: Starting Coldplug All udev Devices...697gitlab # [ 6.635405] systemd[1]: Listening on Journal Log Access Socket.698gitlab # [ 6.639601] systemd-journald[318]: Collecting audit messages is enabled.699gitlab # [ 6.643812] systemd[1]: Mounted Huge Pages File System.700gitlab # [ 6.644430] systemd[1]: Mounted POSIX Message Queue File System.701gitlab # [ 6.644949] systemd[1]: Mounted Kernel Debug File System.702gitlab # [ 6.645439] systemd[1]: Mounted Kernel Trace File System.703gitlab # [ 6.651226] systemd[1]: Finished Create List of Static Device Nodes.704gitlab # [ 6.652311] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.705gitlab # [ 6.655175] systemd[1]: Finished Load Kernel Module 9pnet_virtio.706gitlab # [ 6.655952] systemd[1]: Mounted Kernel Configuration File System.707gitlab # [ 6.658648] systemd[1]: modprobe@fuse.service: Deactivated successfully.708gitlab # [ 6.659653] systemd[1]: Finished Load Kernel Module fuse.709gitlab # [ 6.660825] systemd[1]: Finished Load Kernel Modules.710gitlab # [ 6.670513] systemd[1]: Mounting FUSE Control File System...711gitlab # [ 6.675826] systemd[1]: Starting Firewall...712gitlab # [ 6.678410] EXT4-fs (vda): re-mounted f8f8a416-d088-4cd7-87c9-0708f40d9278.713gitlab # [ 6.680482] systemd[1]: Starting Apply Kernel Variables...714gitlab # [ 6.688162] systemd[1]: Queued start job for default target Multi-User System.715gitlab # [ 6.689864] systemd[1]: Unnecessary job was removed for /dev/vdb.716gitlab # [ 6.691278] systemd[1]: systemd-journald.service: Deactivated successfully.717gitlab # [ 6.694013] systemd-modules-load[319]: Using 3 probe threads718gitlab # [ 6.695222] systemd-modules-load[319]: Module 'atkbd' is built in719gitlab # [ 6.699725] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...720gitlab # [ 6.701554] systemd[1]: Started Journal Service.721gitlab # [ 6.705289] systemd-modules-load[319]: Module 'loop' is built in722gitlab # [ 6.710760] systemd-modules-load[319]: Inserted module 'tls'723gitlab # [ 6.712509] systemd-oomd[320]: No swap; memory pressure usage will be degraded724gitlab # [ 6.715128] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.725gitlab # [ 6.718744] systemd[1]: Finished Remount Root and Kernel File Systems.726gitlab # [ 6.722094] systemd[1]: Mounted FUSE Control File System.727gitlab # [ 6.727441] systemd[1]: Listening on Disk Image Download Service Socket.728gitlab # [ 6.732183] systemd[1]: Starting Flush Journal to Persistent Storage...729gitlab # [ 6.735229] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore730gitlab # [ 6.737292] systemd[1]: Starting Load/Save OS Random Seed...731gitlab # [ 6.738261] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os732gitlab # [ 6.748801] systemd[1]: Finished Apply Kernel Variables.733gitlab # [ 6.751126] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.734gitlab # [ 6.759653] systemd-journald[318]: Received client request to flush runtime journal.735gitlab # [ 6.781088] systemd[1]: Starting Create Static Device Nodes in /dev...736gitlab # [ 6.783619] systemd[1]: Finished Load/Save OS Random Seed.737gitlab # [ 6.786379] systemd[1]: Reached target First Boot Complete.738gitlab # [ 6.787775] systemd[1]: Finished Create Static Device Nodes in /dev.739gitlab # [ 6.788843] systemd[1]: Reached target Preparation for Local File Systems.740gitlab # [ 6.790184] systemd[1]: Starting Rule-based Manager for Device Events and Files...741gitlab # [ 6.791424] systemd[1]: Finished Flush Journal to Persistent Storage.742gitlab # [ 6.837012] systemd-udevd[362]: Using default interface naming scheme 'v261'.743gitlab # [ 6.871169] systemd[1]: Started Rule-based Manager for Device Events and Files.744gitlab # [ 7.075180] systemd[1]: Finished Firewall.745gitlab # [ 7.254521] systemd[1]: Finished Coldplug All udev Devices.746gitlab # [ 7.348681] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs747gitlab # [ 7.396176] systemd[1]: Mounting /run/wrappers...748gitlab # [ 7.468093] systemd[1]: Mounted /run/wrappers.749gitlab # [ 7.476061] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.750gitlab # [ 7.477445] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped.751gitlab # [ 7.483765] systemd[1]: Reached target Local File Systems.752gitlab # [ 7.484981] systemd[1]: Listening on Boot Loader Control Service Socket.753gitlab # [ 7.486349] systemd[1]: Starting register-nix-paths.service...754gitlab # [ 7.489621] systemd[1]: Starting Create SUID/SGID Wrappers...755gitlab # [ 7.491213] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.756gitlab # [ 7.504405] systemd[1]: Starting Save Transient machine-id to Disk...757gitlab # [ 7.512325] systemd[1]: Starting Create System Files and Directories...758gitlab # [ 7.528649] (udev-worker)[413]: Network interface NamePolicy= disabled on kernel command line.759gitlab # [ 7.535662] (udev-worker)[408]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.760gitlab # [ 7.539530] (udev-worker)[408]: Network interface NamePolicy= disabled on kernel command line.761gitlab # [ 7.548365] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.762gitlab # [ 7.554652] systemd[1]: Finished Save Transient machine-id to Disk.763gitlab # [ 7.559167] systemd[1]: Condition check resulted in Virtio network device being skipped.764gitlab # [ 7.560579] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore765gitlab # [ 7.562540] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.766gitlab # [ 7.567707] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67767gitlab # [ 7.577869] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore768gitlab # [ 7.579721] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os769gitlab # [ 7.581701] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os770gitlab # [ 7.583254] systemd[1]: Finished Create System Files and Directories.771gitlab # [ 7.584430] systemd[1]: Starting Rebuild Journal Catalog...772gitlab # [ 7.585496] systemd[1]: Starting Record System Boot/Shutdown in UTMP...773gitlab # [ 7.612829] systemd[1]: Finished Record System Boot/Shutdown in UTMP.774gitlab # [ 7.625672] systemd[1]: Finished Rebuild Journal Catalog.775gitlab # [ 7.627628] systemd[1]: Starting Update is Completed...776gitlab # [ 7.641864] mousedev: PS/2 mouse device common for all mice777gitlab # [ 7.662037] systemd[1]: Finished Update is Completed.778gitlab # [ 7.688967] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.779gitlab # [ 7.690095] systemd[1]: Finished Create SUID/SGID Wrappers.780gitlab # [ 7.691075] systemd[1]: suid-sgid-wrappers.service: Consumed 132ms CPU time over 199ms wall clock time, 6.6M memory peak, 1.9M read from disk.781gitlab # [ 7.944407] systemd[1]: Finished register-nix-paths.service.782gitlab # [ 7.946379] systemd[1]: Reached target System Initialization.783gitlab # [ 7.947840] systemd[1]: Started Discard unused filesystem blocks once a week.784gitlab # [ 7.951295] systemd[1]: Started logrotate.timer.785gitlab # [ 7.952195] systemd[1]: Started Daily Cleanup of Temporary Directories.786gitlab # [ 7.953633] systemd[1]: Reached target Timer Units.787gitlab # [ 7.954450] systemd[1]: Listening on D-Bus System Message Bus Socket.788gitlab # [ 7.955403] systemd[1]: Listening on Nix Daemon Socket.789gitlab # [ 7.964166] systemd[1]: Starting nixbot CI service socket...790gitlab # [ 7.965233] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.791gitlab # [ 7.966482] systemd[1]: Listening on nixbot CI service socket.792gitlab # [ 7.967833] systemd[1]: Reached target Socket Units.793gitlab # [ 7.970564] systemd[1]: Starting D-Bus System Message Bus...794gitlab # [ 8.009980] dbus-broker-launch[564]: Looking up NSS user entry for 'systemd-timesync'...795gitlab # [ 8.011533] dbus-broker-launch[564]: NSS returned no entry for 'systemd-timesync'796gitlab # [ 8.012703] dbus-broker-launch[564]: Invalid user-name in /nix/store/9zcyylhndlnizbwn48627991zr1jxg4p-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"797gitlab # [ 8.017363] systemd[1]: Started D-Bus System Message Bus.798gitlab # [ 8.040164] dbus-broker-launch[564]: Ready799gitlab # [ 8.040981] systemd[1]: Reached target Basic System.800gitlab # [ 8.041760] systemd[1]: Started backdoor.service.801gitlab # [ 8.042470] systemd[1]: Starting gitlab-config.service...802gitlab # connecting to host...803gitlab: Guest shell says: b'Spawning backdoor root shell...\n'804gitlab: connected to guest root shell805gitlab: (connecting took 8.53 seconds)806gitlab: (finished: waiting for the VM to finish booting, in 8.53 seconds)807gitlab # [ 8.116175] systemd[1]: Starting Import lastlog data into lastlog2 database...808gitlab # [ 8.120968] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3809gitlab # [ 8.162179] systemd[1]: Starting Logrotate configuration check...810gitlab # [ 8.165222] systemd[1]: Starting Name Service Cache Daemon (nsncd)...811gitlab # [ 8.179354] systemd[1]: Starting Post-Boot Actions...812gitlab # [ 8.180763] systemd[1]: Started Reset console on configuration changes.813gitlab # [ 8.185063] systemd[1]: Starting resolvconf update...814gitlab # [ 8.187536] logrotate[583]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.815gitlab # [ 8.192402] logrotate[583]: reading config file /nix/store/22afkmbkaxyx50bj9lbkkpmz7pd69hsf-logrotate.conf816gitlab # [ 8.193755] logrotate[583]: note: 'monthly' overrides previously specified 'weekly'817gitlab # [ 8.194832] logrotate[583]: Reading state from file: /var/lib/logrotate.status818gitlab # [ 8.195835] logrotate[583]: state file /var/lib/logrotate.status does not exist819gitlab # [ 8.196987] logrotate[583]: Allocating hash table for state file, size 64 entries820gitlab # [ 8.198174] logrotate[583]: Handling 4 logs821gitlab # [ 8.198863] logrotate[583]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed822gitlab # [ 8.201864] logrotate[583]: considering log /var/log/btmp823gitlab # [ 8.202608] logrotate[583]: Creating new state824gitlab # [ 8.203246] logrotate[583]: Now: 2026-08-16 16:42825gitlab # [ 8.204111] logrotate[583]: Last rotated at 2026-08-16 16:00826gitlab # [ 8.204900] logrotate[583]: log does not need rotating (log has already been rotated)827gitlab # [ 8.206042] logrotate[583]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed828gitlab # [ 8.208694] logrotate[583]: considering log /var/log/wtmp829gitlab # [ 8.209432] logrotate[583]: Creating new state830gitlab # [ 8.210042] logrotate[583]: Now: 2026-08-16 16:42831gitlab # [ 8.210701] logrotate[583]: Last rotated at 2026-08-16 16:00832gitlab # [ 8.211472] logrotate[583]: log does not need rotating (log has already been rotated)833gitlab # [ 8.213989] logrotate[583]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed834gitlab # [ 8.215775] logrotate[583]: switching euid from 0 to 165 and egid from 0 to 165 (pid 583)835gitlab # [ 8.216910] logrotate[583]: considering log /var/gitlab/state/log/*.log836gitlab # [ 8.217756] logrotate[583]: log /var/gitlab/state/log/*.log does not exist -- skipping837gitlab # [ 8.218770] logrotate[583]: Creating new state838gitlab # [ 8.219361] logrotate[583]: switching euid from 165 to 0 and egid from 165 to 0 (pid 583)839gitlab # [ 8.220606] logrotate[583]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed840gitlab # [ 8.222233] logrotate[583]: switching euid from 0 to 60 and egid from 0 to 60 (pid 583)841gitlab # [ 8.223669] logrotate[583]: considering log /var/log/nginx/*.log842gitlab # [ 8.224731] logrotate[583]: log /var/log/nginx/*.log does not exist -- skipping843gitlab # [ 8.225752] logrotate[583]: Creating new state844gitlab # [ 8.226365] logrotate[583]: not running postrotate script, since no logs were rotated845gitlab # [ 8.227373] logrotate[583]: switching euid from 60 to 0 and egid from 60 to 0 (pid 583)846gitlab # [ 8.229478] nsncd[584]: Aug 16 16:42:47.085 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"847gitlab # [ 8.231495] systemd[1]: Started Name Service Cache Daemon (nsncd).848gitlab # [ 8.232654] systemd[1]: Finished Logrotate configuration check.849gitlab # [ 8.233601] systemd[1]: Finished Post-Boot Actions.850gitlab # [ 8.234353] systemd[1]: Finished Import lastlog data into lastlog2 database.851gitlab # [ 8.241330] systemd[1]: Reached target Host and Network Name Lookups.852gitlab # [ 8.242270] systemd[1]: Reached target User and Group Name Lookups.853gitlab # [ 8.247274] systemd[1]: Starting User Login Management...854gitlab # [ 8.248601] systemd[1]: Starting Virtual Console Setup...855gitlab # [ 8.267868] systemd[1]: Stopped target Host and Network Name Lookups.856gitlab # [ 8.269018] systemd[1]: Stopping Host and Network Name Lookups...857gitlab # [ 8.269881] systemd[1]: Stopped target User and Group Name Lookups.858gitlab # [ 8.272871] systemd[1]: Stopping User and Group Name Lookups...859gitlab # [ 8.273836] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...860gitlab # [ 8.276742] systemd[1]: nscd.service: Deactivated successfully.861gitlab # [ 8.277798] systemd[1]: Stopped Name Service Cache Daemon (nsncd).862gitlab # [ 8.278649] systemd[1]: nscd.service: Consumed 23ms CPU time over 109ms wall clock time, 7.8M memory peak, 5.8M read from disk.863gitlab # [ 8.285108] systemd[1]: Starting Name Service Cache Daemon (nsncd)...864gitlab # [ 8.301118] systemd[1]: Finished resolvconf update.865gitlab # [ 8.302203] systemd[1]: Reached target Preparation for Network.866gitlab # [ 8.304447] nsncd[670]: Aug 16 16:42:47.188 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"867gitlab # [ 8.308432] systemd[1]: Starting DHCP Client...868gitlab # [ 8.309535] systemd-logind[635]: New seat seat0.869gitlab # [ 8.310705] systemd[1]: Starting Address configuration of eth1...870gitlab # [ 8.311932] systemd-logind[635]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)871gitlab # [ 8.313595] systemd-logind[635]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)872gitlab # [ 8.315128] systemd-logind[635]: Watching system buttons on /dev/input/event0 (gpio-keys)873gitlab # [ 8.320135] systemd[1]: Starting Extra networking commands....874gitlab # [ 8.321059] systemd[1]: Started Name Service Cache Daemon (nsncd).875gitlab # [ 8.322040] systemd[1]: Started User Login Management.876gitlab # [ 8.322874] systemd[1]: Reached target Host and Network Name Lookups.877gitlab # [ 8.323805] systemd[1]: Reached target User and Group Name Lookups.878gitlab # [ 8.328808] systemd[1]: Starting linger-users.service...879gitlab # [ 8.339505] systemd-vconsole-setup[637]: Configuration of first virtual console was skipped, ignoring remaining ones.880gitlab # [ 8.343952] systemd[1]: Finished Virtual Console Setup.881gitlab # [ 8.352660] systemd[1]: linger-users.service: Deactivated successfully.882gitlab # [ 8.353623] systemd[1]: Finished linger-users.service.883gitlab # [ 8.356485] network-addresses-eth1-start[691]: adding address 192.168.1.1/24... done884gitlab # [ 8.358810] network-addresses-eth1-start[691]: adding address 2001:db8:1::1/64... done885gitlab # [ 8.366223] systemd[1]: Finished Address configuration of eth1.886gitlab # [ 8.418672] dhcpcd[707]: dhcpcd-10.3.2 starting887gitlab # [ 8.419960] systemd[1]: Finished Extra networking commands..888gitlab # [ 8.421039] systemd[1]: Reached target Network.889gitlab # [ 8.422017] dhcpcd[759]: dev: loaded udev890gitlab # [ 8.424329] systemd[1]: Starting gitlab-workhorse.service...891gitlab # [ 8.428640] systemd[1]: Starting Nginx Web Server...892gitlab # [ 8.433031] systemd[1]: Starting PostgreSQL Server...893gitlab # [ 8.438965] 8021q: 802.1Q VLAN Support v1.8894gitlab # [ 8.439369] 8021q: adding VLAN 0 to HW filter on device eth1895gitlab # [ 8.438826] systemd[1]: Starting Redis Server - redis-gitlab...896gitlab # [ 8.440551] systemd[1]: Starting Permit User Sessions...897gitlab # [ 8.451846] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.898gitlab # [ 8.478038] systemd[1]: Finished Permit User Sessions.899gitlab # [ 8.485214] systemd[1]: Started Getty on tty1.[ 8.489122] cfg80211: Loading compiled-in X.509 certificates for regulatory database900gitlab # 901gitlab # [ 8.488984] systemd[1]: Reached target Login Prompts.902gitlab # [ 8.494995] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'903gitlab # [ 8.495663] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'904gitlab # [ 8.497274] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2905gitlab # [ 8.497567] cfg80211: failed to load regulatory.db906gitlab # [ 8.532312] 8021q: adding VLAN 0 to HW filter on device eth0907gitlab # [ 8.529792] dhcpcd[759]: eth0: waiting for carrier908gitlab # [ 8.531585] dhcpcd[759]: eth0: carrier acquired909gitlab # [ 8.536699] dhcpcd[759]: DUID 00:01:00:01:32:14:a5:07:52:54:00:12:34:56910gitlab # [ 8.537720] dhcpcd[759]: eth0: IAID 00:12:34:56911gitlab # [ 8.538387] dhcpcd[759]: eth0: adding address fe80::5054:ff:fe12:3456912gitlab # [ 8.595240] nginx-pre-start[797]: nginx: the configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf syntax is ok913gitlab # [ 8.597507] nginx-pre-start[797]: nginx: configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf test is successful914gitlab # [ 8.603338] systemd[1]: Started Nginx Web Server.915gitlab # [ 8.605337] redis-server[791]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.916gitlab # [ 8.607485] redis-server[791]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo917gitlab # [ 8.608659] redis-server[791]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=791, just started918gitlab # [ 8.610544] redis-server[791]: Configuration loaded919gitlab # [ 8.611558] systemd[1]: Started Redis Server - redis-gitlab.920gitlab # [ 8.612721] redis[791]: monotonic clock: ARM CNTVCT @ 1000 ticks/us921gitlab # [ 8.614123] redis[791]: Running mode=standalone, port=0.922gitlab # [ 8.615205] redis[791]: Server initialized923gitlab # [ 8.616033] redis[791]: Ready to accept connections unix924gitlab # [ 8.617217] redis[791]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.925gitlab # [ 8.631188] postgresql-pre-start[800]: The files belonging to this database system will be owned by user "postgres".926gitlab # [ 8.633496] postgresql-pre-start[800]: This user must also own the server process.927gitlab # [ 8.635081] postgresql-pre-start[800]: The database cluster will be initialized with locale "en_US.UTF-8".928gitlab # [ 8.636511] postgresql-pre-start[800]: The default database encoding has accordingly been set to "UTF8".929gitlab # [ 8.637961] postgresql-pre-start[800]: The default text search configuration will be set to "english".930gitlab # [ 8.639239] postgresql-pre-start[800]: Data page checksums are enabled.931gitlab # [ 8.640340] postgresql-pre-start[800]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok932gitlab # [ 8.641947] postgresql-pre-start[800]: creating subdirectories ... ok933gitlab # [ 8.642898] postgresql-pre-start[800]: selecting dynamic shared memory implementation ... posix934gitlab # [ 8.679495] postgresql-pre-start[800]: selecting default "max_connections" ... 100935gitlab # [ 8.742918] postgresql-pre-start[800]: selecting default "shared_buffers" ... 128MB936gitlab # [ 9.013529] systemd[1]: Started gitlab-workhorse.service.937gitlab # [ 9.185445] gitlab-workhorse[822]: time="2026-08-16T16:42:48Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4938gitlab # [ 9.191392] gitlab-workhorse[822]: time="2026-08-16T16:42:48Z" level=info msg="Using redis/go-redis"939gitlab # [ 9.195515] gitlab-workhorse[822]: time="2026-08-16T16:42:48Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix940gitlab # [ 9.202393] postgresql-pre-start[800]: selecting default time zone ... UTC941gitlab # [ 9.205494] postgresql-pre-start[800]: creating configuration files ... ok942gitlab # [ 9.438317] postgresql-pre-start[800]: running bootstrap script ... ok943gitlab # [ 9.630861] dhcpcd[759]: eth0: soliciting a DHCP lease944gitlab # [ 9.640967] dhcpcd[759]: eth0: offered 10.0.2.15 from 10.0.2.2945gitlab # [ 9.656465] dhcpcd[759]: eth0: probing address 10.0.2.15/24946gitlab # [ 9.983379] dhcpcd[759]: eth0: soliciting an IPv6 router947gitlab # [ 9.987484] dhcpcd[759]: eth0: Router Advertisement from fe80::2948gitlab # [ 9.990412] dhcpcd[759]: eth0: adding address fec0::5054:ff:fe12:3456/64949gitlab # [ 9.993441] dhcpcd[759]: eth0: adding route to fec0::/64950gitlab # [ 9.995920] dhcpcd[759]: eth0: adding default route via fe80::2951gitlab # [ 10.119237] postgresql-pre-start[800]: performing post-bootstrap initialization ... ok952gitlab # [ 10.332152] postgresql-pre-start[800]: syncing data to disk ... ok953gitlab # [ 10.333509] postgresql-pre-start[800]: initdb: warning: enabling "trust" authentication for local connections954gitlab # [ 10.335358] postgresql-pre-start[800]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.955gitlab # [ 10.338462] postgresql-pre-start[800]: Success. You can now start the database server using:956gitlab # [ 10.339944] postgresql-pre-start[800]: pg_ctl -D /var/lib/postgresql/18 -l logfile start957gitlab # [ 10.532471] postgres[854]: [854] LOG: starting PostgreSQL 18.4 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit958gitlab # [ 10.538184] postgres[854]: [854] LOG: listening on IPv6 address "::1", port 5432959gitlab # [ 10.541793] postgres[854]: [854] LOG: listening on IPv4 address "127.0.0.1", port 5432960gitlab # [ 10.546647] postgres[854]: [854] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"961gitlab # [ 10.553494] postgres[865]: [865] LOG: database system was shut down at 2026-08-16 16:42:48 GMT962gitlab # [ 10.562763] postgres[854]: [854] LOG: database system is ready to accept connections963gitlab # [ 10.567542] systemd[1]: Started PostgreSQL Server.964gitlab # [ 10.574754] systemd[1]: Starting PostgreSQL Setup Scripts...965gitlab # [ 10.989015] postgresql-setup-start[876]: CREATE DATABASE966gitlab # [ 11.049031] postgresql-setup-start[886]: CREATE ROLE967gitlab # [ 11.075117] postgresql-setup-start[888]: ALTER DATABASE968gitlab # [ 11.130065] postgresql-setup-start[893]: CREATE ROLE969gitlab # [ 11.133992] systemd[1]: Finished PostgreSQL Setup Scripts.970gitlab # [ 11.136727] systemd[1]: Reached target PostgreSQL.971gitlab # [ 11.138953] systemd[1]: Starting gitlab-postgresql.service...972gitlab # [ 11.191248] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[881]: mkdir -p /var/gitlab/state/home/.ssh: OK973gitlab # [ 11.195696] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[881]: chmod 700 /var/gitlab/state/home/.ssh: OK974gitlab # [ 11.309964] systemd[1]: Finished gitlab-config.service.975gitlab # [ 11.317733] systemd[1]: Started gitaly.service.976gitlab # [ 11.322881] systemd[1]: Starting gitlab-db-config.service...977gitlab # [ 11.340185] gitlab-postgresql-start[905]: CREATE DATABASE978gitlab # [ 11.430803] gitlab-postgresql-start[921]: CREATE EXTENSION979gitlab # [ 11.569649] gitlab-postgresql-start[931]: CREATE EXTENSION980gitlab # [ 11.575212] systemd[1]: Finished gitlab-postgresql.service.981gitlab # [ 11.953887] gitaly[915]: time="2026-08-16T16:42:50.838Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/0r0qd84zrxhqq373hk9spv8j9pg0qlnq-gitaly.toml' and fix the errors that are printed." pid=915982gitlab # [ 11.960272] gitaly[915]: time="2026-08-16T16:42:50.839Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=915983gitlab # [ 11.961974] gitaly[915]: time="2026-08-16T16:42:50.839Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=915984gitlab # [ 11.968098] gitaly[915]: time="2026-08-16T16:42:50.839Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=915985gitlab # [ 11.969888] gitaly[915]: time="2026-08-16T16:42:50.839Z" level=info msg="Starting Gitaly" pid=915 version=986gitlab # [ 12.152063] gitaly[915]: time="2026-08-16T16:42:51.037Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=196 pid=915987gitlab # [ 12.153952] gitaly[915]: time="2026-08-16T16:42:51.037Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=915988gitlab # [ 12.155495] gitaly[915]: time="2026-08-16T16:42:51.038Z" level=info msg="finished initializing command factory" duration_ms=0 pid=915989gitlab # [ 12.157463] gitaly[915]: time="2026-08-16T16:42:51.038Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-915/git-exec-2395820143.d/git pid=915990gitlab # [ 12.159357] gitaly[915]: time="2026-08-16T16:42:51.044Z" level=info msg="finished detecting git version" duration_ms=6 pid=915991gitlab # [ 12.160968] gitaly[915]: time="2026-08-16T16:42:51.044Z" level=info msg="using Git version" pid=915 version=2.53.g992gitlab # [ 12.162344] gitaly[915]: time="2026-08-16T16:42:51.044Z" level=info msg="clearing disk cache object folder" pid=915 storage=default993gitlab # [ 12.163883] gitaly[915]: time="2026-08-16T16:42:51.044Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2645217475 pid=915 storage=default994gitlab # [ 12.166429] gitaly[915]: time="2026-08-16T16:42:51.044Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2645217475 pid=915 storage=default995gitlab # [ 12.169141] gitaly[915]: time="2026-08-16T16:42:51.044Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=915996gitlab # [ 12.171558] gitaly[915]: time="2026-08-16T16:42:51.045Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=915997gitlab # [ 12.174470] gitaly[915]: time="2026-08-16T16:42:51.045Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2645217475 clear_duration_ms=0 pid=915 storage=default998gitlab # [ 12.177584] gitaly[915]: time="2026-08-16T16:42:51.061Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=915999gitlab # [ 12.179808] gitaly[915]: time="2026-08-16T16:42:51.062Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=915 schema=unix1000gitlab # [ 12.181912] gitaly[915]: time="2026-08-16T16:42:51.062Z" level=info msg="listening at address" address=/run/gitaly/gitaly-915/sock.d/intern pid=915 schema=unix1001gitlab # [ 12.184418] gitaly[915]: time="2026-08-16T16:42:51.062Z" level=info msg="counting repositories" pid=9151002gitlab # [ 12.186278] gitaly[915]: time="2026-08-16T16:42:51.062Z" level=info msg="starting to count repositories" pid=915 storage_path=/var/gitlab/state/repositories1003gitlab # [ 12.189014] gitaly[915]: time="2026-08-16T16:42:51.062Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=915 storage_path=/var/gitlab/state/repositories1004gitlab # [ 12.191738] gitaly[915]: time="2026-08-16T16:42:51.062Z" level=info msg="completed counting all repositories" counting_duration=0 pid=9151005gitlab # [ 12.193943] gitaly[915]: time="2026-08-16T16:42:51.062Z" level=info msg="finished tempdir cleaner walk" pid=915 storage=default time_ms=01006gitlab # [ 12.196090] gitaly[915]: time="2026-08-16T16:42:51.063Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9151007gitlab # [ 12.198266] gitaly[915]: time="2026-08-16T16:42:51.063Z" level=info msg="Started Gitaly" duration_ms=223 pid=9151008gitlab # [ 12.199970] gitaly[915]: time="2026-08-16T16:42:51.063Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9151009gitlab # [ 12.202253] gitaly[915]: time="2026-08-16T16:42:51.063Z" level=info msg="maintenance: daily scheduled" pid=915 scheduled="2026-08-17 12:00:00 +0000 UTC"1010gitlab # [ 12.654661] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[920]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1011gitlab # [ 12.665230] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[920]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1012gitlab # [ 12.675208] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[920]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1013gitlab # [ 15.117180] dhcpcd[759]: eth0: leased 10.0.2.15 for 86400 seconds1014gitlab # [ 15.117465] dhcpcd[759]: eth0: adding route to 10.0.2.0/241015gitlab # [ 15.117664] dhcpcd[759]: eth0: adding default route via 10.0.2.21016gitlab # [ 15.311815] systemd[1]: Started DHCP Client.1017gitlab # [ 15.314034] systemd[1]: Reached target Network is Online.1018gitlab # [ 15.457272] gitaly[915]: time="2026-08-16T16:42:54.341Z" level=info msg="License database preloaded" duration_ms=3501 pid=9151019gitlab # [ 56.858446] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[920]: W, [2026-08-16T16:43:35.742416 #920] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1020gitlab # [ 59.246087] gitlab-workhorse[822]: time="2026-08-16T16:43:38Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1021gitlab # [ 59.906924] postgres[1432]: [1432] ERROR: relation "feature_gates" does not exist at character 5231022gitlab # [ 59.908639] postgres[1432]: [1432] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1023gitlab # [ 59.912357] postgres[1432]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1024gitlab # [ 59.916236] postgres[1432]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1025gitlab # [ 59.919746] postgres[1432]: attidentity AS identity,1026gitlab # [ 59.922172] postgres[1432]: attgenerated as attgenerated1027gitlab # [ 59.924680] postgres[1432]: FROM pg_attribute a1028gitlab # [ 59.926678] postgres[1432]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1029gitlab # [ 59.930598] postgres[1432]: LEFT JOIN pg_type t ON a.atttypid = t.oid1030gitlab # [ 59.933478] postgres[1432]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1031gitlab # [ 59.937837] postgres[1432]: WHERE a.attrelid = '"feature_gates"'::regclass1032gitlab # [ 59.940730] postgres[1432]: AND a.attnum > 0 AND NOT a.attisdropped1033gitlab # [ 59.943380] postgres[1432]: ORDER BY a.attnum1034gitlab # [ 59.945361] postgres[1432]:1035gitlab # [ 65.041815] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1483]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1036gitlab # [ 65.044540] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1483]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1037gitlab # [ 69.254829] gitlab-workhorse[822]: time="2026-08-16T16:43:48Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1038gitlab # [ 79.265559] gitlab-workhorse[822]: time="2026-08-16T16:43:58Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1039gitlab # [ 89.266184] gitlab-workhorse[822]: time="2026-08-16T16:44:08Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1040gitlab # [ 91.531354] postgres[1595]: [1595] ERROR: relation "table_without_models" does not exist1041gitlab # [ 91.531739] postgres[1595]: [1595] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1042gitlab # [ 99.274565] gitlab-workhorse[822]: time="2026-08-16T16:44:18Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1043gitlab # [ 109.285338] gitlab-workhorse[822]: time="2026-08-16T16:44:28Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1044gitlab # [ 119.294404] gitlab-workhorse[822]: time="2026-08-16T16:44:38Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1045gitlab # [ 121.142149] systemd[1]: Finished gitlab-db-config.service.1046gitlab # [ 121.148995] systemd[1]: Started gitlab-sidekiq.service.1047gitlab # [ 121.157188] systemd[1]: Starting gitlab.service...1048gitlab # [ 121.708783] bundle[1961]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1049gitlab # [ 121.715095] bundle[1961]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1050gitlab # [ 121.721128] bundle[1961]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1051gitlab # [ 126.325919] bundle[1961]: {"timestamp":"2026-08-16T16:44:45.179Z","pid":1961,"message":"* Enabling systemd notification integration"}1052gitlab # [ 126.326371] bundle[1961]: {"timestamp":"2026-08-16T16:44:45.210Z","pid":1961,"message":"Puma starting in cluster mode..."}1053gitlab # [ 126.326513] bundle[1961]: {"timestamp":"2026-08-16T16:44:45.210Z","pid":1961,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1054gitlab # [ 126.326616] bundle[1961]: {"timestamp":"2026-08-16T16:44:45.210Z","pid":1961,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1055gitlab # [ 126.326739] bundle[1961]: {"timestamp":"2026-08-16T16:44:45.210Z","pid":1961,"message":"* Min threads: 0"}1056gitlab # [ 126.326852] bundle[1961]: {"timestamp":"2026-08-16T16:44:45.210Z","pid":1961,"message":"* Max threads: 4"}1057gitlab # [ 126.326948] bundle[1961]: {"timestamp":"2026-08-16T16:44:45.210Z","pid":1961,"message":"* Environment: production"}1058gitlab # [ 126.327062] bundle[1961]: {"timestamp":"2026-08-16T16:44:45.210Z","pid":1961,"message":"* Master PID: 1961"}1059gitlab # [ 126.327200] bundle[1961]: {"timestamp":"2026-08-16T16:44:45.210Z","pid":1961,"message":"* Workers: 2"}1060gitlab # [ 126.327315] bundle[1961]: {"timestamp":"2026-08-16T16:44:45.210Z","pid":1961,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1061gitlab # [ 126.327434] bundle[1961]: {"timestamp":"2026-08-16T16:44:45.210Z","pid":1961,"message":"* Preloading application"}1062gitlab # [ 126.342173] sidekiq-cluster[1960]: {"severity":"INFO","time":"2026-08-16T16:44:45.188Z","message":"Starting cluster with 1 processes"}1063gitlab # [ 129.295433] gitlab-workhorse[822]: time="2026-08-16T16:44:48Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1064gitlab # [ 139.297801] gitlab-workhorse[822]: time="2026-08-16T16:44:58Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1065gitlab # [ 149.308676] gitlab-workhorse[822]: time="2026-08-16T16:45:08Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1066gitlab # [ 159.322042] gitlab-workhorse[822]: time="2026-08-16T16:45:18Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1067gitlab # [ 164.232450] bundle[1961]: W, [2026-08-16T16:45:23.116807 #1961] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1068gitlab # [ 168.430178] sidekiq-cluster[2009]: 2026-08-16T16:45:27.314Z pid=2009 tid=woh INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2009, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>427507712}1069gitlab # [ 168.694837] sidekiq-cluster[2009]: W, [2026-08-16T16:45:27.580174 #2009] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1070gitlab # [ 168.836435] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:27.721Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1071gitlab # [ 169.342364] gitlab-workhorse[822]: time="2026-08-16T16:45:28Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1072gitlab # [ 172.184578] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.068Z","message":"GitLab reliable fetch activated!"}1073gitlab # [ 172.184957] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.069Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1074gitlab # [ 172.216319] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.101Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1075gitlab # [ 172.223472] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.104Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1076gitlab # [ 172.231672] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.107Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1077gitlab # [ 172.238655] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.110Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1078gitlab # [ 172.246328] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.112Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1079gitlab # [ 172.253155] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.115Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1080gitlab # [ 172.259503] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.117Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1081gitlab # [ 172.264702] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.119Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1082gitlab # [ 172.269445] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.121Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1083gitlab # [ 172.274060] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.123Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1084gitlab # [ 172.279085] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.125Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1085gitlab # [ 172.283484] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.128Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1086gitlab # [ 172.287293] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.130Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1087gitlab # [ 172.291195] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.132Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1088gitlab # [ 172.294849] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.134Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1089gitlab # [ 172.298346] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.136Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1090gitlab # [ 172.301438] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.139Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1091gitlab # [ 172.304291] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.142Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1092gitlab # [ 172.307270] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.145Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1093gitlab # [ 172.310219] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.147Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1094gitlab # [ 172.313385] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.151Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1095gitlab # [ 172.316489] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.153Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1096gitlab # [ 172.319116] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.156Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1097gitlab # [ 172.321887] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.159Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1098gitlab # [ 172.324509] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.161Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1099gitlab # [ 172.326928] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.164Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1100gitlab # [ 172.329296] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.166Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1101gitlab # [ 172.331564] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.169Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1102gitlab # [ 172.334026] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.172Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1103gitlab # [ 172.336366] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.175Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1104gitlab # [ 172.338489] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.177Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1105gitlab # [ 172.340875] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.180Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1106gitlab # [ 172.343066] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.183Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1107gitlab # [ 172.345353] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.185Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1108gitlab # [ 172.347446] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.188Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1109gitlab # [ 172.349680] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.190Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1110gitlab # [ 172.351737] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.192Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1111gitlab # [ 172.353869] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.195Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1112gitlab # [ 172.355872] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.197Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1113gitlab # [ 172.358046] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.199Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1114gitlab # [ 172.360225] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.201Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1115gitlab # [ 172.362322] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.203Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1116gitlab # [ 172.364487] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.205Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1117gitlab # [ 172.366502] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.208Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1118gitlab # [ 172.368704] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.210Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1119gitlab # [ 172.370907] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.213Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1120gitlab # [ 172.373107] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.215Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1121gitlab # [ 172.375243] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.218Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1122gitlab # [ 172.377456] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.220Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1123gitlab # [ 172.379530] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.223Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1124gitlab # [ 172.381777] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.225Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1125gitlab # [ 172.383820] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.228Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1126gitlab # [ 172.386018] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.240Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1127gitlab # [ 172.388292] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.243Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1128gitlab # [ 172.390362] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.246Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1129gitlab # [ 172.392444] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.249Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1130gitlab # [ 172.394522] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.252Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1131gitlab # [ 172.396854] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.255Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1132gitlab # [ 172.399024] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.256Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1133gitlab # [ 172.401324] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.259Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1134gitlab # [ 172.442025] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.326Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1135gitlab # [ 172.444496] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.330Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1136gitlab # [ 172.447462] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.333Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1137gitlab # [ 172.450487] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.336Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1138gitlab # [ 172.454438] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.339Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1139gitlab # [ 172.458904] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.343Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1140gitlab # [ 172.463091] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.346Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1141gitlab # [ 172.467554] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.348Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1142gitlab # [ 172.472253] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.350Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1143gitlab # [ 172.476548] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.352Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1144gitlab # [ 172.480488] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.355Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1145gitlab # [ 172.484180] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.358Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1146gitlab # [ 172.487708] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.360Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1147gitlab # [ 172.491510] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.362Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1148gitlab # [ 172.495128] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.364Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1149gitlab # [ 172.498641] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.367Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1150gitlab # [ 172.501751] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.369Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1151gitlab # [ 172.505088] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.372Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1152gitlab # [ 172.507827] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.374Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1153gitlab # [ 172.510643] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.376Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1154gitlab # [ 172.513497] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.378Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1155gitlab # [ 172.516302] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.380Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1156gitlab # [ 172.518932] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.383Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1157gitlab # [ 172.521530] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.386Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1158gitlab # [ 172.524105] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.388Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1159gitlab # [ 172.526478] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.390Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1160gitlab # [ 172.529102] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.393Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1161gitlab # [ 172.531486] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.395Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1162gitlab # [ 172.534073] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.398Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1163gitlab # [ 172.536458] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.400Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1164gitlab # [ 172.538776] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.402Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1165gitlab # [ 172.541084] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.404Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1166gitlab # [ 172.543321] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.406Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1167gitlab # [ 172.545850] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.408Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1168gitlab # [ 172.547787] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.411Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1169gitlab # [ 172.550255] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.414Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1170gitlab # [ 172.552506] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.417Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1171gitlab # [ 172.554683] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.419Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1172gitlab # [ 172.556967] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.431Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1173gitlab # [ 172.559163] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.434Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1174gitlab # [ 172.561458] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.436Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1175gitlab # [ 172.563683] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.440Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1176gitlab # [ 172.565885] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.443Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1177gitlab # [ 172.568054] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.446Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1178gitlab # [ 172.570386] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.449Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1179gitlab # [ 172.572768] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.451Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1180gitlab # [ 172.574856] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.453Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1181gitlab # [ 172.577197] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.457Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1182gitlab # [ 172.579358] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:45:31.459Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1183gitlab # [ 179.352798] gitlab-workhorse[822]: time="2026-08-16T16:45:38Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1184gitlab # [ 189.354043] gitlab-workhorse[822]: time="2026-08-16T16:45:48Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1185gitlab # [ 199.374272] gitlab-workhorse[822]: time="2026-08-16T16:45:58Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1186gitlab # [ 209.381674] gitlab-workhorse[822]: time="2026-08-16T16:46:08Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1187gitlab # [ 210.047180] postgres[2714]: [2714] ERROR: relation "table_without_models" does not exist1188gitlab # [ 210.050945] postgres[2714]: [2714] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1189gitlab # [ 214.060486] postgres[2748]: [2748] ERROR: relation "table_without_models" does not exist1190gitlab # [ 214.060858] postgres[2748]: [2748] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1191gitlab # [ 215.392326] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:14.277Z","message":"Booted Rails 7.2.3.1 application in production environment"}1192gitlab # [ 215.395131] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:14.280Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1193gitlab # [ 215.400227] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:14.280Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1194gitlab # [ 215.401989] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:14.280Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1195gitlab # [ 215.408091] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:14.284Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1196gitlab # [ 218.545230] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:17.429Z","message":"Cleaning working queues"}1197gitlab # [ 218.552233] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:17.437Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"811e85feaf0608e6cd804128","created_at":"2026-08-16T16:44:39.433Z","trace_propagation_headers":{"sentry-trace":"4b060a00bd0a4e81b2e236a43c55459b-e3753d91bcb74ade","baggage":"sentry-trace_id=4b060a00bd0a4e81b2e236a43c55459b,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"fe6254423a3a7ae5f50ddf30b151f3f7","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-16T16:44:39.445Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-811e85feaf0608e6cd804128: start","job_status":"start","queue_duration_s":97.991841,"scheduling_latency_s":97.991897}1198gitlab # [ 218.901352] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:17.785Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"811e85feaf0608e6cd804128","created_at":"2026-08-16T16:44:39.433Z","trace_propagation_headers":{"sentry-trace":"4b060a00bd0a4e81b2e236a43c55459b-e3753d91bcb74ade","baggage":"sentry-trace_id=4b060a00bd0a4e81b2e236a43c55459b,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"fe6254423a3a7ae5f50ddf30b151f3f7","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-16T16:44:39.445Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-811e85feaf0608e6cd804128: done: 0.348757 sec","job_status":"done","queue_duration_s":97.991841,"scheduling_latency_s":97.991897,"redis_calls":29,"redis_duration_s":0.011363,"redis_read_bytes":282,"redis_write_bytes":3632,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.006632,"redis_feature_flag_read_bytes":272,"redis_feature_flag_write_bytes":2385,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003024,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001707,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":15,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.164619,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.16660706,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.348757,"completed_at":"2026-08-16T16:46:17.785Z","load_balancing_strategy":"primary","db_duration_s":0.087368,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1199gitlab # [ 219.390309] gitlab-workhorse[822]: time="2026-08-16T16:46:18Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1200gitlab # [ 220.606348] bundle[1961]: {"timestamp":"2026-08-16T16:46:19.490Z","pid":1961,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1201gitlab # [ 220.606697] bundle[1961]: {"timestamp":"2026-08-16T16:46:19.490Z","pid":1961,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1202gitlab # [ 220.606880] bundle[1961]: {"timestamp":"2026-08-16T16:46:19.491Z","pid":1961,"message":"! #\u003cThread:0x0000fda3acd861e0 /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1203gitlab # [ 220.606993] bundle[1961]: {"timestamp":"2026-08-16T16:46:19.491Z","pid":1961,"message":"! #\u003cThread:0x0000fda3aadcb1c0 /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1204gitlab # [ 220.607105] bundle[1961]: {"timestamp":"2026-08-16T16:46:19.491Z","pid":1961,"message":"Use Ctrl-C to stop"}1205gitlab # [ 220.607216] bundle[1961]: {"timestamp":"2026-08-16T16:46:19.491Z","pid":1961,"message":"Sending status to systemd every 1.0 sec"}1206gitlab # [ 221.263260] bundle[1961]: {"timestamp":"2026-08-16T16:46:20.148Z","pid":1961,"message":"- Worker 0 (PID: 2866) booted in 0.61s, phase: 0"}1207gitlab # [ 221.268844] bundle[1961]: {"timestamp":"2026-08-16T16:46:20.149Z","pid":1961,"message":"- Worker 1 (PID: 2870) booted in 0.59s, phase: 0"}1208gitlab # [ 221.277992] systemd[1]: Started gitlab.service.1209gitlab # [ 221.280254] systemd[1]: Reached target Common target for all GitLab services..1210gitlab # [ 221.283230] systemd[1]: Starting setup-gitlab.service...1211gitlab # [ 221.344879] setup-gitlab-start[2894]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1212gitlab # [ 224.841723] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:46:23 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 34441213gitlab # [ 224.846614] setup-gitlab-start[2894]: + TOKEN=nixbot-test-token-of-20-chars1214gitlab # [ 224.847302] setup-gitlab-start[2894]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1215gitlab # [ 224.867448] runuser[2920]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1216gitlab # [ 225.391420] setup-gitlab-start[2921]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1217gitlab # [ 225.398062] setup-gitlab-start[2921]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1218gitlab # [ 225.404373] setup-gitlab-start[2921]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1219gitlab # [ 226.209450] setup-gitlab-start[2921]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1220gitlab # [ 226.209794] setup-gitlab-start[2921]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1221gitlab # [ 226.212070] setup-gitlab-start[2921]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1222gitlab # [ 231.601102] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:30.485Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"6b47e735d7074d91727a4311","created_at":"2026-08-16T16:46:30.400Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f8ac6972ac26fa6c22afd297efc12832","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:30.482Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-6b47e735d7074d91727a4311: start","job_status":"start","queue_duration_s":0.002013,"scheduling_latency_s":0.002052}1223gitlab # [ 231.750892] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:30.636Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1224gitlab # [ 231.789819] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:30.673Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"6b47e735d7074d91727a4311","created_at":"2026-08-16T16:46:30.400Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f8ac6972ac26fa6c22afd297efc12832","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:30.482Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-6b47e735d7074d91727a4311: done: 0.188758 sec","job_status":"done","queue_duration_s":0.002013,"scheduling_latency_s":0.002052,"redis_calls":10,"redis_duration_s":0.025298,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002883,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.019329,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003086,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041444,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0033094,"duration_s":0.188758,"completed_at":"2026-08-16T16:46:30.673Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.029532,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1225gitlab # [ 231.885694] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:30.684Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"bd58e6e03a0a17000dbb7367","created_at":"2026-08-16T16:46:30.531Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:30.544Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-bd58e6e03a0a17000dbb7367: start","job_status":"start","queue_duration_s":0.139699,"scheduling_latency_s":0.139749}1226gitlab # [ 232.444525] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:31.328Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"bd58e6e03a0a17000dbb7367","created_at":"2026-08-16T16:46:30.531Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:30.544Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-bd58e6e03a0a17000dbb7367: done: 0.644685 sec","job_status":"done","queue_duration_s":0.139699,"scheduling_latency_s":0.139749,"redis_calls":71,"redis_duration_s":0.23747900000000002,"redis_read_bytes":120,"redis_write_bytes":42624,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.018549,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001991,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.211324,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.005615,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.273988,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.03744704,"duration_s":0.644685,"completed_at":"2026-08-16T16:46:31.328Z","load_balancing_strategy":"primary","db_duration_s":0.015105,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1227gitlab # [ 232.540599] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:31.351Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"c2e3b010948f56fa3d0a5596","created_at":"2026-08-16T16:46:30.576Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3e6f6ba65e821ae116b247496252e5d7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:30.591Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-c2e3b010948f56fa3d0a5596: start","job_status":"start","queue_duration_s":0.758968,"scheduling_latency_s":0.759016}1228gitlab # [ 232.558573] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:31.401Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1229gitlab # [ 232.607039] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:31.490Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"c2e3b010948f56fa3d0a5596","created_at":"2026-08-16T16:46:30.576Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3e6f6ba65e821ae116b247496252e5d7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:30.591Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-c2e3b010948f56fa3d0a5596: done: 0.13953 sec","job_status":"done","queue_duration_s":0.758968,"scheduling_latency_s":0.759016,"redis_calls":10,"redis_duration_s":0.028263,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000913,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.026227,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001123,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031821,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00689346,"duration_s":0.13953,"completed_at":"2026-08-16T16:46:31.490Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.02058,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1230gitlab # [ 232.701563] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:31.502Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::PipelineArtifacts::ExpireArtifactsWorker","jid":"1faa60f422387107e012b7a3","created_at":"2026-08-16T16:46:30.608Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"52c2e7f47175bb90c5889f2188abf98a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:35dc78c13bdf78a98c09fc2795030a4961be87ad882288b77a6a3c9be677e4d5","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:30.623Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::ExpireArtifactsWorker JID-1faa60f422387107e012b7a3: start","job_status":"start","queue_duration_s":0.878657,"scheduling_latency_s":0.878705}1231gitlab # [ 232.781046] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:31.665Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::PipelineArtifacts::ExpireArtifactsWorker","jid":"1faa60f422387107e012b7a3","created_at":"2026-08-16T16:46:30.608Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"52c2e7f47175bb90c5889f2188abf98a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:35dc78c13bdf78a98c09fc2795030a4961be87ad882288b77a6a3c9be677e4d5","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:30.623Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::ExpireArtifactsWorker JID-1faa60f422387107e012b7a3: done: 0.163171 sec","job_status":"done","queue_duration_s":0.878657,"scheduling_latency_s":0.878705,"redis_calls":12,"redis_duration_s":0.018166,"redis_read_bytes":11,"redis_write_bytes":1481,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003876,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.009069,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.005221,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":548,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.051048,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00254852,"exclusive_lock_hold_duration_s":0.06285373999999999,"extra.ci_pipeline_artifacts_expire_artifacts_worker.destroyed_pipeline_artifacts_count":0,"duration_s":0.163171,"completed_at":"2026-08-16T16:46:31.665Z","load_balancing_strategy":"primary","db_duration_s":0.055308,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1232gitlab # [ 232.870632] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:31.672Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"bfb14c7e64de3caafbd5d807","created_at":"2026-08-16T16:46:30.651Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5e65e0175b2ffb1e30eafe19702ad99d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-16T16:46:30.681Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-bfb14c7e64de3caafbd5d807: start","job_status":"start","queue_duration_s":0.991493,"scheduling_latency_s":0.99154}1233gitlab # [ 232.888294] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:31.718Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1234gitlab # [ 232.892946] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:31.748Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"bfb14c7e64de3caafbd5d807","created_at":"2026-08-16T16:46:30.651Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5e65e0175b2ffb1e30eafe19702ad99d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-16T16:46:30.681Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-bfb14c7e64de3caafbd5d807: done: 0.075566 sec","job_status":"done","queue_duration_s":0.991493,"scheduling_latency_s":0.99154,"redis_calls":10,"redis_duration_s":0.005311,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002477,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002036,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000798,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031519,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0006384,"duration_s":0.075566,"completed_at":"2026-08-16T16:46:31.748Z","load_balancing_strategy":"primary","db_duration_s":0.007295,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1235gitlab # [ 232.942007] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:31.751Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"7952ed256246c2c699cbddec","created_at":"2026-08-16T16:46:30.714Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"823410ad8a92690397173b25a4bfe191","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:30.748Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-7952ed256246c2c699cbddec: start","job_status":"start","queue_duration_s":1.003524,"scheduling_latency_s":1.003567}1236gitlab # [ 232.956630] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:31.836Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"7952ed256246c2c699cbddec","created_at":"2026-08-16T16:46:30.714Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"823410ad8a92690397173b25a4bfe191","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:30.748Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-7952ed256246c2c699cbddec: done: 0.085074 sec","job_status":"done","queue_duration_s":1.003524,"scheduling_latency_s":1.003567,"redis_calls":12,"redis_duration_s":0.004344,"redis_read_bytes":11,"redis_write_bytes":1482,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00173,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00189,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000724,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.029,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035203,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0006695,"duration_s":0.085074,"completed_at":"2026-08-16T16:46:31.836Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.029135,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1237gitlab # [ 232.998556] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:31.839Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"304e188ba8538224b2d3d1f4","created_at":"2026-08-16T16:46:30.769Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1010f427484b8204d7a567cdeb034129","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:30.795Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-304e188ba8538224b2d3d1f4: start","job_status":"start","queue_duration_s":1.044251,"scheduling_latency_s":1.044287}1238gitlab # [ 233.055647] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:31.940Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"304e188ba8538224b2d3d1f4","created_at":"2026-08-16T16:46:30.769Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1010f427484b8204d7a567cdeb034129","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:30.795Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-304e188ba8538224b2d3d1f4: done: 0.101112 sec","job_status":"done","queue_duration_s":1.044251,"scheduling_latency_s":1.044287,"redis_calls":12,"redis_duration_s":0.003384,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00044,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001755,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001189,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.061976,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00069126,"exclusive_lock_hold_duration_s":0.043567879999999996,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.101112,"completed_at":"2026-08-16T16:46:31.940Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.026486,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1239gitlab # [ 233.114809] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:31.947Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"64e922596f63e5e1e1266252","created_at":"2026-08-16T16:46:30.857Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3c1c8fbba97a53c7986c3e6e1fc20810","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:30.878Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-64e922596f63e5e1e1266252: start","job_status":"start","queue_duration_s":1.068928,"scheduling_latency_s":1.068959}1240gitlab # [ 233.129804] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.002Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"64e922596f63e5e1e1266252","created_at":"2026-08-16T16:46:30.857Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3c1c8fbba97a53c7986c3e6e1fc20810","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:30.878Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-64e922596f63e5e1e1266252: done: 0.055751 sec","job_status":"done","queue_duration_s":1.068928,"scheduling_latency_s":1.068959,"redis_calls":14,"redis_duration_s":0.0034660000000000003,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001309,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001173,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000984,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031349,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00070488,"exclusive_lock_hold_duration_s":0.024251400000000003,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.055751,"completed_at":"2026-08-16T16:46:32.002Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015339,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1241gitlab # [ 233.174947] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.004Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"aae2d0c5541bcaf4693da6ba","created_at":"2026-08-16T16:46:30.908Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aa45fbfedfb783906f731a09e358ae30","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:30.947Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-aae2d0c5541bcaf4693da6ba: start","job_status":"start","queue_duration_s":1.056654,"scheduling_latency_s":1.056674}1242gitlab # [ 233.188780] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.056Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"aae2d0c5541bcaf4693da6ba","created_at":"2026-08-16T16:46:30.908Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aa45fbfedfb783906f731a09e358ae30","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:30.947Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-aae2d0c5541bcaf4693da6ba: done: 0.052117 sec","job_status":"done","queue_duration_s":1.056654,"scheduling_latency_s":1.056674,"redis_calls":10,"redis_duration_s":0.00168,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000263,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001065,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000352,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017934,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036864,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.052117,"completed_at":"2026-08-16T16:46:32.056Z","load_balancing_strategy":"primary","db_duration_s":0.025653,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1243gitlab # [ 233.231056] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.058Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"7c53104ec136e0bf9950cb7c","created_at":"2026-08-16T16:46:30.983Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5e03b742cdfd0386acc6f5df9a29d165","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.004Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-7c53104ec136e0bf9950cb7c: start","job_status":"start","queue_duration_s":1.053372,"scheduling_latency_s":1.053399}1244gitlab # [ 233.245679] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.097Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"7c53104ec136e0bf9950cb7c","created_at":"2026-08-16T16:46:30.983Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5e03b742cdfd0386acc6f5df9a29d165","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.004Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-7c53104ec136e0bf9950cb7c: done: 0.039347 sec","job_status":"done","queue_duration_s":1.053372,"scheduling_latency_s":1.053399,"redis_calls":10,"redis_duration_s":0.0018889999999999998,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000381,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00112,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000388,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023445,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033274,"duration_s":0.039347,"completed_at":"2026-08-16T16:46:32.097Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006064,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1245gitlab # [ 233.289255] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.099Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"ca6ca2f6e8d951d63cd5349b","created_at":"2026-08-16T16:46:31.025Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"76bd25d7190f8f3392d23089532f44a8","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.055Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-ca6ca2f6e8d951d63cd5349b: start","job_status":"start","queue_duration_s":1.043912,"scheduling_latency_s":1.043937}1246gitlab # [ 233.303505] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.137Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"ca6ca2f6e8d951d63cd5349b","created_at":"2026-08-16T16:46:31.025Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"76bd25d7190f8f3392d23089532f44a8","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.055Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-ca6ca2f6e8d951d63cd5349b: done: 0.038855 sec","job_status":"done","queue_duration_s":1.043912,"scheduling_latency_s":1.043937,"redis_calls":13,"redis_duration_s":0.002235,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000351,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001117,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000767,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025466,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01261272,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.038855,"completed_at":"2026-08-16T16:46:32.137Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004348,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1247gitlab # [ 233.347573] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.139Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"8322576ec085ac2424203cd3","created_at":"2026-08-16T16:46:31.076Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9e0244e6a6715b8f70b4292a33a056fd","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.099Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-8322576ec085ac2424203cd3: start","job_status":"start","queue_duration_s":1.039624,"scheduling_latency_s":1.039648}1248gitlab # [ 233.362093] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.165Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"8322576ec085ac2424203cd3","created_at":"2026-08-16T16:46:31.076Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9e0244e6a6715b8f70b4292a33a056fd","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.099Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-8322576ec085ac2424203cd3: done: 0.025795 sec","job_status":"done","queue_duration_s":1.039624,"scheduling_latency_s":1.039648,"redis_calls":12,"redis_duration_s":0.001919,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000324,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000873,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000722,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015241,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00050432,"exclusive_lock_hold_duration_s":0.0038784600000000002,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.025795,"completed_at":"2026-08-16T16:46:32.165Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002244,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1249gitlab # [ 233.405336] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.166Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"8f45ff8e76bcda6bc13c8568","created_at":"2026-08-16T16:46:31.131Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"772234799ebd4103e94e4fe2599b3c82","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.155Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-8f45ff8e76bcda6bc13c8568: start","job_status":"start","queue_duration_s":1.011561,"scheduling_latency_s":1.011581}1250gitlab # [ 233.419764] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.179Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1251gitlab # [ 233.423764] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.186Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"8f45ff8e76bcda6bc13c8568","created_at":"2026-08-16T16:46:31.131Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"772234799ebd4103e94e4fe2599b3c82","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.155Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-8f45ff8e76bcda6bc13c8568: done: 0.019988 sec","job_status":"done","queue_duration_s":1.011561,"scheduling_latency_s":1.011581,"redis_calls":10,"redis_duration_s":0.001565,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000481,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000787,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000297,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011739,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026712,"duration_s":0.019988,"completed_at":"2026-08-16T16:46:32.186Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000634,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1252gitlab # [ 233.466465] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.188Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"76c7ed846c85c893bff0ec1a","created_at":"2026-08-16T16:46:31.183Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e80aaf8deafa43e464ab83e37a992014","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.204Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-76c7ed846c85c893bff0ec1a: start","job_status":"start","queue_duration_s":0.984058,"scheduling_latency_s":0.98408}1253gitlab # [ 233.481604] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.213Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"76c7ed846c85c893bff0ec1a","created_at":"2026-08-16T16:46:31.183Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e80aaf8deafa43e464ab83e37a992014","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.204Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-76c7ed846c85c893bff0ec1a: done: 0.02556 sec","job_status":"done","queue_duration_s":0.984058,"scheduling_latency_s":0.98408,"redis_calls":10,"redis_duration_s":0.001598,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000281,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000816,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000501,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014368,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025094,"duration_s":0.02556,"completed_at":"2026-08-16T16:46:32.213Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004162,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1254gitlab # [ 233.523738] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.215Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"fd5733ea2523de2479dd0d3f","created_at":"2026-08-16T16:46:31.224Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"760a6b5ec9e6bacd6de1dfa98741706f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-16T16:46:31.248Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-fd5733ea2523de2479dd0d3f: start","job_status":"start","queue_duration_s":0.966124,"scheduling_latency_s":0.966141}1255gitlab # [ 233.537077] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.248Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"fd5733ea2523de2479dd0d3f","created_at":"2026-08-16T16:46:31.224Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"760a6b5ec9e6bacd6de1dfa98741706f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-16T16:46:31.248Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-fd5733ea2523de2479dd0d3f: done: 0.033879 sec","job_status":"done","queue_duration_s":0.966124,"scheduling_latency_s":0.966141,"redis_calls":10,"redis_duration_s":0.001349,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000278,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000796,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000275,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020179,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022436,"duration_s":0.033879,"completed_at":"2026-08-16T16:46:32.248Z","load_balancing_strategy":"primary","db_duration_s":0.007219,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1256gitlab # [ 233.578470] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.250Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"68bd911bb1d83830145a6ee0","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-68bd911bb1d83830145a6ee0: start","job_status":"start","queue_duration_s":0.995103,"scheduling_latency_s":0.995121}1257gitlab # [ 233.591017] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.271Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"68bd911bb1d83830145a6ee0","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-68bd911bb1d83830145a6ee0: done: 0.020872 sec","job_status":"done","queue_duration_s":0.995103,"scheduling_latency_s":0.995121,"redis_calls":16,"redis_duration_s":0.002066,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000261,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001246,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013121,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022066,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020872,"completed_at":"2026-08-16T16:46:32.270Z","load_balancing_strategy":"primary","db_duration_s":0.000591,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1258gitlab # [ 233.633017] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.272Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"07fc937af2e55d28259861f1","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-07fc937af2e55d28259861f1: start","job_status":"start","queue_duration_s":1.017093,"scheduling_latency_s":1.01711}1259gitlab # [ 233.645565] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.287Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"07fc937af2e55d28259861f1","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-07fc937af2e55d28259861f1: done: 0.015104 sec","job_status":"done","queue_duration_s":1.017093,"scheduling_latency_s":1.01711,"redis_calls":13,"redis_duration_s":0.001606,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001065,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010251,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015104,"completed_at":"2026-08-16T16:46:32.287Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1260gitlab # [ 233.685562] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.288Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"976e9be801b69c65166783bb","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-976e9be801b69c65166783bb: start","job_status":"start","queue_duration_s":1.033303,"scheduling_latency_s":1.033322}1261gitlab # [ 233.697970] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.302Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"976e9be801b69c65166783bb","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-976e9be801b69c65166783bb: done: 0.014405 sec","job_status":"done","queue_duration_s":1.033303,"scheduling_latency_s":1.033322,"redis_calls":13,"redis_duration_s":0.001372,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000493,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000879,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009779,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014405,"completed_at":"2026-08-16T16:46:32.302Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1262gitlab # [ 233.736912] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.303Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f1cf49a00b8a10f15fe90b8","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f1cf49a00b8a10f15fe90b8: start","job_status":"start","queue_duration_s":1.048729,"scheduling_latency_s":1.048747}1263gitlab # [ 233.749169] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.318Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f1cf49a00b8a10f15fe90b8","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f1cf49a00b8a10f15fe90b8: done: 0.014267 sec","job_status":"done","queue_duration_s":1.048729,"scheduling_latency_s":1.048747,"redis_calls":13,"redis_duration_s":0.0014810000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000953,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009953,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014267,"completed_at":"2026-08-16T16:46:32.317Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1264gitlab # [ 233.788718] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.319Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bbad3d5c1e494242a8270ba7","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bbad3d5c1e494242a8270ba7: start","job_status":"start","queue_duration_s":1.064197,"scheduling_latency_s":1.064215}1265gitlab # [ 233.801291] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.333Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bbad3d5c1e494242a8270ba7","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bbad3d5c1e494242a8270ba7: done: 0.013969 sec","job_status":"done","queue_duration_s":1.064197,"scheduling_latency_s":1.064215,"redis_calls":13,"redis_duration_s":0.001405,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000502,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000903,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009723,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013969,"completed_at":"2026-08-16T16:46:32.333Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1266gitlab # [ 233.841094] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.334Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb3736c0fa77ca4b38b7ebfa","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb3736c0fa77ca4b38b7ebfa: start","job_status":"start","queue_duration_s":1.079378,"scheduling_latency_s":1.079394}1267gitlab # [ 233.853445] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.348Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb3736c0fa77ca4b38b7ebfa","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb3736c0fa77ca4b38b7ebfa: done: 0.014363 sec","job_status":"done","queue_duration_s":1.079378,"scheduling_latency_s":1.079394,"redis_calls":13,"redis_duration_s":0.001398,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000874,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009903,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014363,"completed_at":"2026-08-16T16:46:32.348Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1268gitlab # [ 233.894164] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.350Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6055ee496519d8e1876c2c59","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6055ee496519d8e1876c2c59: start","job_status":"start","queue_duration_s":1.09494,"scheduling_latency_s":1.094959}1269gitlab # [ 233.906889] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.364Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6055ee496519d8e1876c2c59","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6055ee496519d8e1876c2c59: done: 0.014298 sec","job_status":"done","queue_duration_s":1.09494,"scheduling_latency_s":1.094959,"redis_calls":13,"redis_duration_s":0.001409,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000884,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010074,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014298,"completed_at":"2026-08-16T16:46:32.364Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1270gitlab # [ 233.946392] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.365Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"88e01d7da72e63cfb1364248","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-88e01d7da72e63cfb1364248: start","job_status":"start","queue_duration_s":1.110479,"scheduling_latency_s":1.110496}1271gitlab # [ 233.958906] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.380Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"88e01d7da72e63cfb1364248","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-88e01d7da72e63cfb1364248: done: 0.014478 sec","job_status":"done","queue_duration_s":1.110479,"scheduling_latency_s":1.110496,"redis_calls":13,"redis_duration_s":0.001358,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000858,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010037,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014478,"completed_at":"2026-08-16T16:46:32.379Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1272gitlab # [ 233.998219] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.381Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a999420cb346533e81e3a852","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a999420cb346533e81e3a852: start","job_status":"start","queue_duration_s":1.125989,"scheduling_latency_s":1.126007}1273gitlab # [ 234.010846] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.395Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a999420cb346533e81e3a852","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a999420cb346533e81e3a852: done: 0.014348 sec","job_status":"done","queue_duration_s":1.125989,"scheduling_latency_s":1.126007,"redis_calls":13,"redis_duration_s":0.001387,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000496,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000891,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010056,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014348,"completed_at":"2026-08-16T16:46:32.395Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1274gitlab # [ 234.050102] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.396Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9065e1a788febe0c51477f72","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9065e1a788febe0c51477f72: start","job_status":"start","queue_duration_s":1.141695,"scheduling_latency_s":1.141713}1275gitlab # [ 234.062500] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.411Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9065e1a788febe0c51477f72","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9065e1a788febe0c51477f72: done: 0.014767 sec","job_status":"done","queue_duration_s":1.141695,"scheduling_latency_s":1.141713,"redis_calls":13,"redis_duration_s":0.001448,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000927,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010149,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014767,"completed_at":"2026-08-16T16:46:32.411Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1276gitlab # [ 234.102565] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.412Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04736053f1f2d308c81f0370","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04736053f1f2d308c81f0370: start","job_status":"start","queue_duration_s":1.157466,"scheduling_latency_s":1.157484}1277gitlab # [ 234.114845] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.426Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04736053f1f2d308c81f0370","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04736053f1f2d308c81f0370: done: 0.014264 sec","job_status":"done","queue_duration_s":1.157466,"scheduling_latency_s":1.157484,"redis_calls":13,"redis_duration_s":0.001408,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000903,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009723,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014264,"completed_at":"2026-08-16T16:46:32.426Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1278gitlab # [ 234.153943] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.427Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"11109461dc3049992a3d7760","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-11109461dc3049992a3d7760: start","job_status":"start","queue_duration_s":1.172821,"scheduling_latency_s":1.172838}1279gitlab # [ 234.166164] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.442Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"11109461dc3049992a3d7760","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-11109461dc3049992a3d7760: done: 0.014683 sec","job_status":"done","queue_duration_s":1.172821,"scheduling_latency_s":1.172838,"redis_calls":13,"redis_duration_s":0.0014199999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000913,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009852,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014683,"completed_at":"2026-08-16T16:46:32.442Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1280gitlab # [ 234.205035] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.443Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"07a5b330e85f46605fdb5e70","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-07a5b330e85f46605fdb5e70: start","job_status":"start","queue_duration_s":1.188756,"scheduling_latency_s":1.188774}1281gitlab # [ 234.217339] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.458Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"07a5b330e85f46605fdb5e70","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-07a5b330e85f46605fdb5e70: done: 0.014321 sec","job_status":"done","queue_duration_s":1.188756,"scheduling_latency_s":1.188774,"redis_calls":13,"redis_duration_s":0.001413,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000891,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009846,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014321,"completed_at":"2026-08-16T16:46:32.458Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1282gitlab # [ 234.256157] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.459Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"141084e9b03794fc3b626815","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-141084e9b03794fc3b626815: start","job_status":"start","queue_duration_s":1.20411,"scheduling_latency_s":1.204126}1283gitlab # [ 234.268319] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.473Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"141084e9b03794fc3b626815","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-141084e9b03794fc3b626815: done: 0.013973 sec","job_status":"done","queue_duration_s":1.20411,"scheduling_latency_s":1.204126,"redis_calls":13,"redis_duration_s":0.001421,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000897,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009748,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013973,"completed_at":"2026-08-16T16:46:32.473Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1284gitlab # [ 234.308211] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.474Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abf3d4762ba037cb1bf949e7","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abf3d4762ba037cb1bf949e7: start","job_status":"start","queue_duration_s":1.219419,"scheduling_latency_s":1.219436}1285gitlab # [ 234.320216] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.489Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abf3d4762ba037cb1bf949e7","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abf3d4762ba037cb1bf949e7: done: 0.014688 sec","job_status":"done","queue_duration_s":1.219419,"scheduling_latency_s":1.219436,"redis_calls":13,"redis_duration_s":0.001677,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000752,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000925,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010147,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014688,"completed_at":"2026-08-16T16:46:32.489Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1286gitlab # [ 234.359091] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.490Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37438f5094a49969189b6737","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37438f5094a49969189b6737: start","job_status":"start","queue_duration_s":1.235378,"scheduling_latency_s":1.235395}1287gitlab # [ 234.371336] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.504Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37438f5094a49969189b6737","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37438f5094a49969189b6737: done: 0.014233 sec","job_status":"done","queue_duration_s":1.235378,"scheduling_latency_s":1.235395,"redis_calls":13,"redis_duration_s":0.001411,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000502,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000909,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009983,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014233,"completed_at":"2026-08-16T16:46:32.504Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1288gitlab # [ 234.411162] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.505Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce36a2224be39ab93afb5ad4","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce36a2224be39ab93afb5ad4: start","job_status":"start","queue_duration_s":1.250838,"scheduling_latency_s":1.250856}1289gitlab # [ 234.423845] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.520Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce36a2224be39ab93afb5ad4","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce36a2224be39ab93afb5ad4: done: 0.014154 sec","job_status":"done","queue_duration_s":1.250838,"scheduling_latency_s":1.250856,"redis_calls":13,"redis_duration_s":0.001398,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000891,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010022,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014154,"completed_at":"2026-08-16T16:46:32.519Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1290gitlab # [ 234.464097] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.521Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"039206f51cb6106e67b993ff","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-039206f51cb6106e67b993ff: start","job_status":"start","queue_duration_s":1.266274,"scheduling_latency_s":1.266291}1291gitlab # [ 234.476587] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.535Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"039206f51cb6106e67b993ff","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-039206f51cb6106e67b993ff: done: 0.014462 sec","job_status":"done","queue_duration_s":1.266274,"scheduling_latency_s":1.266291,"redis_calls":13,"redis_duration_s":0.0014329999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00089,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010238,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014462,"completed_at":"2026-08-16T16:46:32.535Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1292gitlab # [ 234.517802] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.536Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f17f547082e9338a32af7aaa","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f17f547082e9338a32af7aaa: start","job_status":"start","queue_duration_s":1.281723,"scheduling_latency_s":1.28174}1293gitlab # [ 234.530327] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.551Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f17f547082e9338a32af7aaa","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f17f547082e9338a32af7aaa: done: 0.01428 sec","job_status":"done","queue_duration_s":1.281723,"scheduling_latency_s":1.28174,"redis_calls":13,"redis_duration_s":0.001358,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000483,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000875,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009811,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01428,"completed_at":"2026-08-16T16:46:32.550Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1294gitlab # [ 234.569807] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.552Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3fb53eba0d8352bafa4c6356","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3fb53eba0d8352bafa4c6356: start","job_status":"start","queue_duration_s":1.297043,"scheduling_latency_s":1.29706}1295gitlab # [ 234.582101] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.566Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3fb53eba0d8352bafa4c6356","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3fb53eba0d8352bafa4c6356: done: 0.014431 sec","job_status":"done","queue_duration_s":1.297043,"scheduling_latency_s":1.29706,"redis_calls":13,"redis_duration_s":0.001473,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000936,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01008,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014431,"completed_at":"2026-08-16T16:46:32.566Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1296gitlab # [ 234.620664] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.567Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94b1662a15633e7209273a03","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94b1662a15633e7209273a03: start","job_status":"start","queue_duration_s":1.312724,"scheduling_latency_s":1.312743}1297gitlab # [ 234.633343] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.582Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94b1662a15633e7209273a03","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94b1662a15633e7209273a03: done: 0.014799 sec","job_status":"done","queue_duration_s":1.312724,"scheduling_latency_s":1.312743,"redis_calls":13,"redis_duration_s":0.001412,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000897,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009818,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014799,"completed_at":"2026-08-16T16:46:32.582Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1298gitlab # [ 234.672244] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.583Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2cd7cc916edc923237bb2eca","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2cd7cc916edc923237bb2eca: start","job_status":"start","queue_duration_s":1.328567,"scheduling_latency_s":1.328584}1299gitlab # [ 234.684530] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.597Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2cd7cc916edc923237bb2eca","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2cd7cc916edc923237bb2eca: done: 0.014366 sec","job_status":"done","queue_duration_s":1.328567,"scheduling_latency_s":1.328584,"redis_calls":13,"redis_duration_s":0.0013930000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00087,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009755,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014366,"completed_at":"2026-08-16T16:46:32.597Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1300gitlab # [ 234.724523] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.599Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a2765a7f1fe08900cba1ceea","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a2765a7f1fe08900cba1ceea: start","job_status":"start","queue_duration_s":1.343981,"scheduling_latency_s":1.343999}1301gitlab # [ 234.737329] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.613Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a2765a7f1fe08900cba1ceea","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a2765a7f1fe08900cba1ceea: done: 0.014099 sec","job_status":"done","queue_duration_s":1.343981,"scheduling_latency_s":1.343999,"redis_calls":13,"redis_duration_s":0.001434,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000908,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009811,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014099,"completed_at":"2026-08-16T16:46:32.613Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1302gitlab # [ 234.776534] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.614Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d28cd27b8a55e60aad8cd693","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d28cd27b8a55e60aad8cd693: start","job_status":"start","queue_duration_s":1.359422,"scheduling_latency_s":1.359441}1303gitlab # [ 234.789076] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.628Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d28cd27b8a55e60aad8cd693","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d28cd27b8a55e60aad8cd693: done: 0.014302 sec","job_status":"done","queue_duration_s":1.359422,"scheduling_latency_s":1.359441,"redis_calls":13,"redis_duration_s":0.001398,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000886,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009892,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014302,"completed_at":"2026-08-16T16:46:32.628Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1304gitlab # [ 234.828284] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.630Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f83e74a31d0906b949096034","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f83e74a31d0906b949096034: start","job_status":"start","queue_duration_s":1.374922,"scheduling_latency_s":1.37494}1305gitlab # [ 234.840771] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.643Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f83e74a31d0906b949096034","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f83e74a31d0906b949096034: done: 0.014025 sec","job_status":"done","queue_duration_s":1.374922,"scheduling_latency_s":1.37494,"redis_calls":13,"redis_duration_s":0.0013830000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000871,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009905,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014025,"completed_at":"2026-08-16T16:46:32.643Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1306gitlab # [ 234.880259] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.645Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d5c53c29f112e952eff4a2e","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d5c53c29f112e952eff4a2e: start","job_status":"start","queue_duration_s":1.390281,"scheduling_latency_s":1.3903}1307gitlab # [ 234.892692] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.659Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d5c53c29f112e952eff4a2e","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d5c53c29f112e952eff4a2e: done: 0.014012 sec","job_status":"done","queue_duration_s":1.390281,"scheduling_latency_s":1.3903,"redis_calls":13,"redis_duration_s":0.001396,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000498,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000898,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009904,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014012,"completed_at":"2026-08-16T16:46:32.659Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1308gitlab # [ 234.933134] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.660Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e9b927bde6f5f5a5b279a5f2","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e9b927bde6f5f5a5b279a5f2: start","job_status":"start","queue_duration_s":1.4055,"scheduling_latency_s":1.405517}1309gitlab # [ 234.945958] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.674Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e9b927bde6f5f5a5b279a5f2","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e9b927bde6f5f5a5b279a5f2: done: 0.014169 sec","job_status":"done","queue_duration_s":1.4055,"scheduling_latency_s":1.405517,"redis_calls":13,"redis_duration_s":0.001396,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00089,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010019,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014169,"completed_at":"2026-08-16T16:46:32.674Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1310gitlab # [ 234.985635] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.676Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd256a13b2e15419f9681bc3","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd256a13b2e15419f9681bc3: start","job_status":"start","queue_duration_s":1.420977,"scheduling_latency_s":1.420996}1311gitlab # [ 234.997989] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.690Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd256a13b2e15419f9681bc3","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd256a13b2e15419f9681bc3: done: 0.01453 sec","job_status":"done","queue_duration_s":1.420977,"scheduling_latency_s":1.420996,"redis_calls":13,"redis_duration_s":0.001616,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000719,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000897,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010129,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01453,"completed_at":"2026-08-16T16:46:32.690Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1312gitlab # [ 235.037556] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.691Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a9243cb034c11abca83e7b47","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a9243cb034c11abca83e7b47: start","job_status":"start","queue_duration_s":1.436572,"scheduling_latency_s":1.43659}1313gitlab # [ 235.050349] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.705Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a9243cb034c11abca83e7b47","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a9243cb034c11abca83e7b47: done: 0.014224 sec","job_status":"done","queue_duration_s":1.436572,"scheduling_latency_s":1.43659,"redis_calls":13,"redis_duration_s":0.001542,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00049,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001052,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009859,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014224,"completed_at":"2026-08-16T16:46:32.705Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1314gitlab # [ 235.089873] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.706Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ec7e70b29e1aa7d6f185c9c7","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ec7e70b29e1aa7d6f185c9c7: start","job_status":"start","queue_duration_s":1.451875,"scheduling_latency_s":1.451892}1315gitlab # [ 235.102570] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.807Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ec7e70b29e1aa7d6f185c9c7","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ec7e70b29e1aa7d6f185c9c7: done: 0.100537 sec","job_status":"done","queue_duration_s":1.451875,"scheduling_latency_s":1.451892,"redis_calls":13,"redis_duration_s":0.001817,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00064,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001177,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.095607,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.100537,"completed_at":"2026-08-16T16:46:32.807Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1316gitlab # [ 235.143770] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.808Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"004aeecd6a021ff1a3e2abb8","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-004aeecd6a021ff1a3e2abb8: start","job_status":"start","queue_duration_s":1.553629,"scheduling_latency_s":1.553648}1317gitlab # [ 235.156566] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.822Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"004aeecd6a021ff1a3e2abb8","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-004aeecd6a021ff1a3e2abb8: done: 0.014122 sec","job_status":"done","queue_duration_s":1.553629,"scheduling_latency_s":1.553648,"redis_calls":13,"redis_duration_s":0.001415,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000902,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009939,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014122,"completed_at":"2026-08-16T16:46:32.822Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1318gitlab # [ 235.196577] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.823Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31936c45f258adb8be661008","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31936c45f258adb8be661008: start","job_status":"start","queue_duration_s":1.56882,"scheduling_latency_s":1.568836}1319gitlab # [ 235.208959] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.837Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31936c45f258adb8be661008","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31936c45f258adb8be661008: done: 0.013235 sec","job_status":"done","queue_duration_s":1.56882,"scheduling_latency_s":1.568836,"redis_calls":13,"redis_duration_s":0.001358,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000487,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000871,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009148,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013235,"completed_at":"2026-08-16T16:46:32.837Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1320gitlab # [ 235.248750] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.838Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"56edad01d524190271c942e5","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-56edad01d524190271c942e5: start","job_status":"start","queue_duration_s":1.58314,"scheduling_latency_s":1.583158}1321gitlab # [ 235.261339] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.852Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"56edad01d524190271c942e5","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-56edad01d524190271c942e5: done: 0.013974 sec","job_status":"done","queue_duration_s":1.58314,"scheduling_latency_s":1.583158,"redis_calls":13,"redis_duration_s":0.001389,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000881,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00926,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013974,"completed_at":"2026-08-16T16:46:32.852Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1322gitlab # [ 235.301086] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.853Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb624872d5649d41f9054f60","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb624872d5649d41f9054f60: start","job_status":"start","queue_duration_s":1.598728,"scheduling_latency_s":1.598746}1323gitlab # [ 235.313406] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.867Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb624872d5649d41f9054f60","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb624872d5649d41f9054f60: done: 0.013804 sec","job_status":"done","queue_duration_s":1.598728,"scheduling_latency_s":1.598746,"redis_calls":13,"redis_duration_s":0.001386,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00049,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000896,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009671,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013804,"completed_at":"2026-08-16T16:46:32.867Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1324gitlab # [ 235.353857] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.868Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c37a8bbf4570659d0f48f4f9","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c37a8bbf4570659d0f48f4f9: start","job_status":"start","queue_duration_s":1.613538,"scheduling_latency_s":1.613556}1325gitlab # [ 235.366283] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.882Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c37a8bbf4570659d0f48f4f9","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c37a8bbf4570659d0f48f4f9: done: 0.013826 sec","job_status":"done","queue_duration_s":1.613538,"scheduling_latency_s":1.613556,"redis_calls":13,"redis_duration_s":0.001373,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000482,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000891,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009788,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013826,"completed_at":"2026-08-16T16:46:32.882Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1326gitlab # [ 235.405240] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.883Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b15b9c98d8fd20ef3ecd2716","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b15b9c98d8fd20ef3ecd2716: start","job_status":"start","queue_duration_s":1.628662,"scheduling_latency_s":1.62868}1327gitlab # [ 235.417679] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.897Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b15b9c98d8fd20ef3ecd2716","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b15b9c98d8fd20ef3ecd2716: done: 0.014132 sec","job_status":"done","queue_duration_s":1.628662,"scheduling_latency_s":1.62868,"redis_calls":13,"redis_duration_s":0.00145,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000901,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009961,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014132,"completed_at":"2026-08-16T16:46:32.897Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1328gitlab # [ 235.456746] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.898Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b6f80fd9829310745141ef6c","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b6f80fd9829310745141ef6c: start","job_status":"start","queue_duration_s":1.643861,"scheduling_latency_s":1.643878}1329gitlab # [ 235.468966] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.912Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b6f80fd9829310745141ef6c","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b6f80fd9829310745141ef6c: done: 0.014094 sec","job_status":"done","queue_duration_s":1.643861,"scheduling_latency_s":1.643878,"redis_calls":13,"redis_duration_s":0.001369,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000489,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00088,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009202,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014094,"completed_at":"2026-08-16T16:46:32.912Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1330gitlab # [ 235.508134] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.914Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"85df8a65dfc76bd58159b2e2","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-85df8a65dfc76bd58159b2e2: start","job_status":"start","queue_duration_s":1.65967,"scheduling_latency_s":1.659688}1331gitlab # [ 235.521258] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.928Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"85df8a65dfc76bd58159b2e2","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-85df8a65dfc76bd58159b2e2: done: 0.01378 sec","job_status":"done","queue_duration_s":1.65967,"scheduling_latency_s":1.659688,"redis_calls":13,"redis_duration_s":0.001374,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00086,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009611,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01378,"completed_at":"2026-08-16T16:46:32.928Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1332gitlab # [ 235.560305] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.929Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27e93eebcfbd6520cf201ae6","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27e93eebcfbd6520cf201ae6: start","job_status":"start","queue_duration_s":1.674499,"scheduling_latency_s":1.674515}1333gitlab # [ 235.572281] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.943Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27e93eebcfbd6520cf201ae6","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27e93eebcfbd6520cf201ae6: done: 0.01391 sec","job_status":"done","queue_duration_s":1.674499,"scheduling_latency_s":1.674515,"redis_calls":13,"redis_duration_s":0.001374,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000495,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000879,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009859,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01391,"completed_at":"2026-08-16T16:46:32.943Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1334gitlab # [ 235.610927] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.944Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90d397aaf9da92ecfb24a3eb","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90d397aaf9da92ecfb24a3eb: start","job_status":"start","queue_duration_s":1.689481,"scheduling_latency_s":1.689499}1335gitlab # [ 235.623338] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.958Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90d397aaf9da92ecfb24a3eb","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90d397aaf9da92ecfb24a3eb: done: 0.014093 sec","job_status":"done","queue_duration_s":1.689481,"scheduling_latency_s":1.689499,"redis_calls":13,"redis_duration_s":0.0014069999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00089,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009972,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014093,"completed_at":"2026-08-16T16:46:32.958Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1336gitlab # [ 235.662683] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.959Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b7f6835a7e68d11aafd7a170","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b7f6835a7e68d11aafd7a170: start","job_status":"start","queue_duration_s":1.70474,"scheduling_latency_s":1.704757}1337gitlab # [ 235.675252] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.974Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b7f6835a7e68d11aafd7a170","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b7f6835a7e68d11aafd7a170: done: 0.014232 sec","job_status":"done","queue_duration_s":1.70474,"scheduling_latency_s":1.704757,"redis_calls":13,"redis_duration_s":0.001375,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000501,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000874,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00925,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014232,"completed_at":"2026-08-16T16:46:32.973Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1338gitlab # [ 235.714173] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.975Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c39b05aa74adb1d619563639","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c39b05aa74adb1d619563639: start","job_status":"start","queue_duration_s":1.720742,"scheduling_latency_s":1.720759}1339gitlab # [ 235.727667] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.990Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c39b05aa74adb1d619563639","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c39b05aa74adb1d619563639: done: 0.014247 sec","job_status":"done","queue_duration_s":1.720742,"scheduling_latency_s":1.720759,"redis_calls":13,"redis_duration_s":0.0015509999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001047,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010029,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014247,"completed_at":"2026-08-16T16:46:32.989Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1340gitlab # [ 235.767716] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:32.991Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"07c119ee62f73a5a46fee030","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-07c119ee62f73a5a46fee030: start","job_status":"start","queue_duration_s":1.735989,"scheduling_latency_s":1.736005}1341gitlab # [ 235.780352] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.005Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"07c119ee62f73a5a46fee030","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-07c119ee62f73a5a46fee030: done: 0.014519 sec","job_status":"done","queue_duration_s":1.735989,"scheduling_latency_s":1.736005,"redis_calls":13,"redis_duration_s":0.001483,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000961,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010389,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014519,"completed_at":"2026-08-16T16:46:33.005Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1342gitlab # [ 235.819794] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.006Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a4f1b3ea98c08dad97a36f0e","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a4f1b3ea98c08dad97a36f0e: start","job_status":"start","queue_duration_s":1.751522,"scheduling_latency_s":1.751539}1343gitlab # [ 235.832396] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.021Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a4f1b3ea98c08dad97a36f0e","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a4f1b3ea98c08dad97a36f0e: done: 0.014485 sec","job_status":"done","queue_duration_s":1.751522,"scheduling_latency_s":1.751539,"redis_calls":13,"redis_duration_s":0.0014169999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000896,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010348,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014485,"completed_at":"2026-08-16T16:46:33.020Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1344gitlab # [ 235.871773] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.022Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a705c938efacce76c7780310","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a705c938efacce76c7780310: start","job_status":"start","queue_duration_s":1.767042,"scheduling_latency_s":1.76706}1345gitlab # [ 235.884523] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.037Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a705c938efacce76c7780310","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a705c938efacce76c7780310: done: 0.01506 sec","job_status":"done","queue_duration_s":1.767042,"scheduling_latency_s":1.76706,"redis_calls":13,"redis_duration_s":0.0016120000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000612,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010078,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01506,"completed_at":"2026-08-16T16:46:33.037Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1346gitlab # [ 235.925278] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.039Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8701b5150547eeedb03cf94","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8701b5150547eeedb03cf94: start","job_status":"start","queue_duration_s":1.78315,"scheduling_latency_s":1.783929}1347gitlab # [ 235.938746] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.054Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c8701b5150547eeedb03cf94","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c8701b5150547eeedb03cf94: done: 0.016282 sec","job_status":"done","queue_duration_s":1.78315,"scheduling_latency_s":1.783929,"redis_calls":13,"redis_duration_s":0.0015899999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001035,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009834,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016282,"completed_at":"2026-08-16T16:46:33.054Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1348gitlab # [ 235.978234] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.055Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb252980cb70831314dfcf8c","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb252980cb70831314dfcf8c: start","job_status":"start","queue_duration_s":1.800642,"scheduling_latency_s":1.80066}1349gitlab # [ 235.990677] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.069Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb252980cb70831314dfcf8c","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb252980cb70831314dfcf8c: done: 0.014194 sec","job_status":"done","queue_duration_s":1.800642,"scheduling_latency_s":1.80066,"redis_calls":13,"redis_duration_s":0.001394,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000867,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014194,"completed_at":"2026-08-16T16:46:33.069Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1350gitlab # [ 236.030019] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.070Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9ca037ee120cae68f80cf53a","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9ca037ee120cae68f80cf53a: start","job_status":"start","queue_duration_s":1.81584,"scheduling_latency_s":1.815857}1351gitlab # [ 236.042343] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.085Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9ca037ee120cae68f80cf53a","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9ca037ee120cae68f80cf53a: done: 0.014545 sec","job_status":"done","queue_duration_s":1.81584,"scheduling_latency_s":1.815857,"redis_calls":13,"redis_duration_s":0.0014320000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000495,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000937,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010153,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014545,"completed_at":"2026-08-16T16:46:33.085Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1352gitlab # [ 236.081847] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.086Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff896acdb57ebb31407da87f","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff896acdb57ebb31407da87f: start","job_status":"start","queue_duration_s":1.831423,"scheduling_latency_s":1.831441}1353gitlab # [ 236.094732] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.100Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff896acdb57ebb31407da87f","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff896acdb57ebb31407da87f: done: 0.014181 sec","job_status":"done","queue_duration_s":1.831423,"scheduling_latency_s":1.831441,"redis_calls":13,"redis_duration_s":0.001439,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000498,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000941,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010019,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014181,"completed_at":"2026-08-16T16:46:33.100Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1354gitlab # [ 236.136309] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.101Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a923d3ce0dc70eda9c5f2fe","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a923d3ce0dc70eda9c5f2fe: start","job_status":"start","queue_duration_s":1.846592,"scheduling_latency_s":1.846609}1355gitlab # [ 236.148724] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.115Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a923d3ce0dc70eda9c5f2fe","created_at":"2026-08-16T16:46:30.787Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-f214fcec548e48e2","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"3cbb5b5a6a48bed6453370e940b30747","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.255Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a923d3ce0dc70eda9c5f2fe: done: 0.013916 sec","job_status":"done","queue_duration_s":1.846592,"scheduling_latency_s":1.846609,"redis_calls":13,"redis_duration_s":0.0013319999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000489,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000843,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009033,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013916,"completed_at":"2026-08-16T16:46:33.115Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1356gitlab # [ 236.189457] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.117Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"6ef17924fcb37639a49038e8","created_at":"2026-08-16T16:46:31.305Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a8c71f23b6b897d18c259ba228d0242e","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.332Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-6ef17924fcb37639a49038e8: start","job_status":"start","queue_duration_s":1.784909,"scheduling_latency_s":1.784927}1357gitlab # [ 236.204494] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.144Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"6ef17924fcb37639a49038e8","created_at":"2026-08-16T16:46:31.305Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a8c71f23b6b897d18c259ba228d0242e","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.332Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-6ef17924fcb37639a49038e8: done: 0.026995 sec","job_status":"done","queue_duration_s":1.784909,"scheduling_latency_s":1.784927,"redis_calls":12,"redis_duration_s":0.001607,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000308,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000718,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000581,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015199,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00051196,"exclusive_lock_hold_duration_s":0.007418500000000001,"duration_s":0.026995,"completed_at":"2026-08-16T16:46:33.144Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005138,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1358gitlab # [ 236.248374] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.145Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"714badb68631cec748dd588d","created_at":"2026-08-16T16:46:31.342Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d4dbcbaf90af1dc29bab2501c310a2e9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.382Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-714badb68631cec748dd588d: start","job_status":"start","queue_duration_s":1.762616,"scheduling_latency_s":1.762632}1359gitlab # [ 236.262076] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.179Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"714badb68631cec748dd588d","created_at":"2026-08-16T16:46:31.342Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d4dbcbaf90af1dc29bab2501c310a2e9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.382Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-714badb68631cec748dd588d: done: 0.034495 sec","job_status":"done","queue_duration_s":1.762616,"scheduling_latency_s":1.762632,"redis_calls":19,"redis_duration_s":0.0024560000000000003,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000549,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000201,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.001275,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000431,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025101,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023112,"duration_s":0.034495,"completed_at":"2026-08-16T16:46:33.179Z","load_balancing_strategy":"primary","db_duration_s":0.00343,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1360gitlab # [ 236.305946] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.181Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"8d6dce9b73d8f1aa1075ff8c","created_at":"2026-08-16T16:46:31.388Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d32462c772d5cc2a1289be0707c6da2c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.409Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-8d6dce9b73d8f1aa1075ff8c: start","job_status":"start","queue_duration_s":1.771855,"scheduling_latency_s":1.771896}1361gitlab # [ 236.320193] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.209Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"8d6dce9b73d8f1aa1075ff8c","created_at":"2026-08-16T16:46:31.388Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d32462c772d5cc2a1289be0707c6da2c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.409Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-8d6dce9b73d8f1aa1075ff8c: done: 0.027806 sec","job_status":"done","queue_duration_s":1.771855,"scheduling_latency_s":1.771896,"redis_calls":12,"redis_duration_s":0.001551,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000263,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000698,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00059,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015558,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00045882,"exclusive_lock_hold_duration_s":0.0087632,"duration_s":0.027806,"completed_at":"2026-08-16T16:46:33.209Z","load_balancing_strategy":"primary","db_duration_s":0.005212,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1362gitlab # [ 236.364289] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.210Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"029f2a084b7f6f4b73a702a6","created_at":"2026-08-16T16:46:31.422Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b2895bae28e5b4d9305f1b3faa7feca9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.448Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-029f2a084b7f6f4b73a702a6: start","job_status":"start","queue_duration_s":1.761784,"scheduling_latency_s":1.7618}1363gitlab # [ 236.407662] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.221Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1364gitlab # [ 236.416321] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.228Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"029f2a084b7f6f4b73a702a6","created_at":"2026-08-16T16:46:31.422Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b2895bae28e5b4d9305f1b3faa7feca9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.448Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-029f2a084b7f6f4b73a702a6: done: 0.018377 sec","job_status":"done","queue_duration_s":1.761784,"scheduling_latency_s":1.7618,"redis_calls":10,"redis_duration_s":0.001255,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00026,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000714,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000281,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010781,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002237,"duration_s":0.018377,"completed_at":"2026-08-16T16:46:33.228Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000649,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1365gitlab # [ 236.481547] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.230Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"b0e2381b6618cb4f7c784b04","created_at":"2026-08-16T16:46:31.482Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"11c53e87dd0d4cb03b5dfef35a0f84f5","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.499Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-b0e2381b6618cb4f7c784b04: start","job_status":"start","queue_duration_s":1.730769,"scheduling_latency_s":1.730785}1366gitlab # [ 236.495603] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.248Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"b0e2381b6618cb4f7c784b04","created_at":"2026-08-16T16:46:31.482Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"11c53e87dd0d4cb03b5dfef35a0f84f5","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.499Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-b0e2381b6618cb4f7c784b04: done: 0.018092 sec","job_status":"done","queue_duration_s":1.730769,"scheduling_latency_s":1.730785,"redis_calls":12,"redis_duration_s":0.0015609999999999999,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000341,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000249,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000703,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000268,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011666,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022184,"duration_s":0.018092,"completed_at":"2026-08-16T16:46:33.248Z","load_balancing_strategy":"primary","db_duration_s":0.000586,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1367gitlab # [ 236.538119] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.249Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"cd9f4f17475d9c896c110b0e","created_at":"2026-08-16T16:46:31.523Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c061e8f84cff5871e3392f4262f4a914","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.545Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-cd9f4f17475d9c896c110b0e: start","job_status":"start","queue_duration_s":1.703656,"scheduling_latency_s":1.703672}1368gitlab # [ 236.552973] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.284Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"cd9f4f17475d9c896c110b0e","created_at":"2026-08-16T16:46:31.523Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c061e8f84cff5871e3392f4262f4a914","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.545Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-cd9f4f17475d9c896c110b0e: done: 0.035453 sec","job_status":"done","queue_duration_s":1.703656,"scheduling_latency_s":1.703672,"redis_calls":16,"redis_duration_s":0.002138,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001136,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000732,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00027,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019555,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002301,"duration_s":0.035453,"completed_at":"2026-08-16T16:46:33.284Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008948,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1369gitlab # [ 236.595053] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.285Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"20063aad94e3387dd4be9be5","created_at":"2026-08-16T16:46:31.579Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a12bbe3c3cdccfcfac423e4271f13f9d","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.590Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-20063aad94e3387dd4be9be5: start","job_status":"start","queue_duration_s":1.695624,"scheduling_latency_s":1.695641}1370gitlab # [ 236.637825] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.592Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"20063aad94e3387dd4be9be5","created_at":"2026-08-16T16:46:31.579Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a12bbe3c3cdccfcfac423e4271f13f9d","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.590Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-20063aad94e3387dd4be9be5: done: 0.306417 sec","job_status":"done","queue_duration_s":1.695624,"scheduling_latency_s":1.695641,"redis_calls":565,"redis_duration_s":0.054921,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000286,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000954,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.053681,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.28294,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023554,"duration_s":0.306417,"completed_at":"2026-08-16T16:46:33.592Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000589,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1371gitlab # [ 236.709895] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.593Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"4ef4ada53080c7cad830723b","created_at":"2026-08-16T16:46:31.596Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"512ef519d84fb2ce5850507bc3a2e454","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.627Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-4ef4ada53080c7cad830723b: start","job_status":"start","queue_duration_s":1.96593,"scheduling_latency_s":1.965946}1372gitlab # [ 236.725769] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.841Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"4ef4ada53080c7cad830723b","created_at":"2026-08-16T16:46:31.596Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"512ef519d84fb2ce5850507bc3a2e454","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.627Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-4ef4ada53080c7cad830723b: done: 0.248514 sec","job_status":"done","queue_duration_s":1.96593,"scheduling_latency_s":1.965946,"redis_calls":14,"redis_duration_s":0.00189,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000517,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000737,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000636,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.049,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.049,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.181572,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00044764,"exclusive_lock_hold_duration_s":0.22612298,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.248514,"completed_at":"2026-08-16T16:46:33.841Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.074219,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1373gitlab # [ 236.773279] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.843Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"23c1e478be612ca107b54ff0","created_at":"2026-08-16T16:46:31.657Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"316ee161342b37e6e5a9ceea48da9290","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.676Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-23c1e478be612ca107b54ff0: start","job_status":"start","queue_duration_s":2.166716,"scheduling_latency_s":2.166732}1374gitlab # [ 236.788098] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.863Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"23c1e478be612ca107b54ff0","created_at":"2026-08-16T16:46:31.657Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"316ee161342b37e6e5a9ceea48da9290","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-16T16:46:31.676Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-23c1e478be612ca107b54ff0: done: 0.020862 sec","job_status":"done","queue_duration_s":2.166716,"scheduling_latency_s":2.166732,"redis_calls":10,"redis_duration_s":0.001386,"redis_read_bytes":9,"redis_write_bytes":1299,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000286,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000755,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000345,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0118,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002484,"duration_s":0.020862,"completed_at":"2026-08-16T16:46:33.863Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000632,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1375gitlab # [ 236.831553] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.865Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"5e13a4044ac436107a4bfd86","created_at":"2026-08-16T16:46:31.706Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"81c80abb731b38aa60c2d06b55ff498f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-16T16:46:31.743Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-5e13a4044ac436107a4bfd86: start","job_status":"start","queue_duration_s":2.121834,"scheduling_latency_s":2.121851}1376gitlab # [ 236.845277] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.877Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1377gitlab # [ 236.848602] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.886Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"5e13a4044ac436107a4bfd86","created_at":"2026-08-16T16:46:31.706Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"81c80abb731b38aa60c2d06b55ff498f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-16T16:46:31.743Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-5e13a4044ac436107a4bfd86: done: 0.021359 sec","job_status":"done","queue_duration_s":2.121834,"scheduling_latency_s":2.121851,"redis_calls":10,"redis_duration_s":0.00125,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000257,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000714,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000279,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012229,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022988,"duration_s":0.021359,"completed_at":"2026-08-16T16:46:33.886Z","load_balancing_strategy":"primary","db_duration_s":0.000599,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1378gitlab # [ 236.890767] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.888Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"d3174c2780667aa85e0febe1","created_at":"2026-08-16T16:46:33.161Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-0c42bfbe7d84499e","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d4dbcbaf90af1dc29bab2501c310a2e9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:33.173Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-d3174c2780667aa85e0febe1: start","job_status":"start","queue_duration_s":0.714492,"scheduling_latency_s":0.714509}1379gitlab # [ 236.903520] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.906Z","message":"No existing merge request to be cleaned up."}1380gitlab # [ 236.905330] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.921Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"d3174c2780667aa85e0febe1","created_at":"2026-08-16T16:46:33.161Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-0c42bfbe7d84499e","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d4dbcbaf90af1dc29bab2501c310a2e9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:33.173Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-d3174c2780667aa85e0febe1: done: 0.032773 sec","job_status":"done","queue_duration_s":0.714492,"scheduling_latency_s":0.714509,"redis_calls":13,"redis_duration_s":0.0017439999999999999,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000276,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000693,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000775,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019986,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023082,"duration_s":0.032773,"completed_at":"2026-08-16T16:46:33.920Z","load_balancing_strategy":"primary","db_duration_s":0.005257,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1381gitlab # [ 236.946670] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.922Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b7f69804096c24a3c7bac4fa","created_at":"2026-08-16T16:46:33.161Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-0c42bfbe7d84499e","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d4dbcbaf90af1dc29bab2501c310a2e9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:33.173Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b7f69804096c24a3c7bac4fa: start","job_status":"start","queue_duration_s":0.748305,"scheduling_latency_s":0.748321}1382gitlab # [ 236.984171] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.933Z","message":"No existing merge request to be cleaned up."}1383gitlab # [ 236.990308] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.942Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b7f69804096c24a3c7bac4fa","created_at":"2026-08-16T16:46:33.161Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-0c42bfbe7d84499e","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d4dbcbaf90af1dc29bab2501c310a2e9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:33.173Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b7f69804096c24a3c7bac4fa: done: 0.020145 sec","job_status":"done","queue_duration_s":0.748305,"scheduling_latency_s":0.748321,"redis_calls":10,"redis_duration_s":0.002316,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00107,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001246,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013985,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020145,"completed_at":"2026-08-16T16:46:33.942Z","load_balancing_strategy":"primary","db_duration_s":0.002498,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1384gitlab # [ 237.062214] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.943Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"fe28f0068773b1339e2ab61d","created_at":"2026-08-16T16:46:33.161Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-0c42bfbe7d84499e","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d4dbcbaf90af1dc29bab2501c310a2e9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:33.173Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-fe28f0068773b1339e2ab61d: start","job_status":"start","queue_duration_s":0.769491,"scheduling_latency_s":0.769508}1385gitlab # [ 237.074632] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.954Z","message":"No existing merge request to be cleaned up."}1386gitlab # [ 237.076263] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.962Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"fe28f0068773b1339e2ab61d","created_at":"2026-08-16T16:46:33.161Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-0c42bfbe7d84499e","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d4dbcbaf90af1dc29bab2501c310a2e9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:33.173Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-fe28f0068773b1339e2ab61d: done: 0.019453 sec","job_status":"done","queue_duration_s":0.769491,"scheduling_latency_s":0.769508,"redis_calls":10,"redis_duration_s":0.001277,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000748,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013386,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019453,"completed_at":"2026-08-16T16:46:33.962Z","load_balancing_strategy":"primary","db_duration_s":0.002332,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1387gitlab # [ 237.115066] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.964Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e0d444e1e8d8d3fd9a908bb9","created_at":"2026-08-16T16:46:33.161Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-0c42bfbe7d84499e","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d4dbcbaf90af1dc29bab2501c310a2e9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:33.173Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e0d444e1e8d8d3fd9a908bb9: start","job_status":"start","queue_duration_s":0.790401,"scheduling_latency_s":0.790419}1388gitlab # [ 237.127706] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.975Z","message":"No existing merge request to be cleaned up."}1389gitlab # [ 237.129463] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:46:33.983Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e0d444e1e8d8d3fd9a908bb9","created_at":"2026-08-16T16:46:33.161Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-0c42bfbe7d84499e","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"d4dbcbaf90af1dc29bab2501c310a2e9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:46:33.173Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e0d444e1e8d8d3fd9a908bb9: done: 0.019213 sec","job_status":"done","queue_duration_s":0.790401,"scheduling_latency_s":0.790419,"redis_calls":10,"redis_duration_s":0.001324,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000556,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000768,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013702,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019213,"completed_at":"2026-08-16T16:46:33.983Z","load_balancing_strategy":"primary","db_duration_s":0.002261,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1390gitlab # [ 267.746977] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:06.630Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"fe6c7737edd230cc415d83f7","created_at":"2026-08-16T16:47:06.543Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"62e1569cb0ca44ec72644c182df10d22","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-16T16:47:06.564Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-fe6c7737edd230cc415d83f7: start","job_status":"start","queue_duration_s":0.066227,"scheduling_latency_s":0.066287}1391gitlab # [ 267.787338] setup-gitlab-start[2921]: W, [2026-08-16T16:47:06.672516 #2921] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1392gitlab # [ 267.805152] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:06.690Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1393gitlab # [ 267.849669] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:06.734Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"fe6c7737edd230cc415d83f7","created_at":"2026-08-16T16:47:06.543Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"62e1569cb0ca44ec72644c182df10d22","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-16T16:47:06.564Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-fe6c7737edd230cc415d83f7: done: 0.103424 sec","job_status":"done","queue_duration_s":0.066227,"scheduling_latency_s":0.066287,"redis_calls":8,"redis_duration_s":0.016029,"redis_read_bytes":133,"redis_write_bytes":890,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.001243,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":64,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.01263,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002156,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029609,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.103424,"completed_at":"2026-08-16T16:47:06.733Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1394gitlab # [ 267.932385] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:06.738Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"1baeb09878f657b7a14251ca","created_at":"2026-08-16T16:47:06.632Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-16T16:47:06.646Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-1baeb09878f657b7a14251ca: start","job_status":"start","queue_duration_s":0.091654,"scheduling_latency_s":0.091707}1395gitlab # [ 268.445713] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:07.330Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"1baeb09878f657b7a14251ca","created_at":"2026-08-16T16:47:06.632Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-16T16:47:06.646Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-1baeb09878f657b7a14251ca: done: 0.591776 sec","job_status":"done","queue_duration_s":0.091654,"scheduling_latency_s":0.091707,"redis_calls":60,"redis_duration_s":0.108876,"redis_read_bytes":108,"redis_write_bytes":41109,"redis_queues_calls":2,"redis_queues_duration_s":0.001546,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.092195,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.015135,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.244839,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.591776,"completed_at":"2026-08-16T16:47:07.329Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1396gitlab # [ 268.538752] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:07.358Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"292785a7560aae08cca52b63","created_at":"2026-08-16T16:47:06.662Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"592ef948896ba9eb8d54aa7c7ed59abd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-16T16:47:06.683Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-292785a7560aae08cca52b63: start","job_status":"start","queue_duration_s":0.675268,"scheduling_latency_s":0.675319}1397gitlab # [ 268.589678] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:07.474Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1398gitlab # [ 268.612233] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:07.496Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"292785a7560aae08cca52b63","created_at":"2026-08-16T16:47:06.662Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"592ef948896ba9eb8d54aa7c7ed59abd","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-16T16:47:06.683Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-292785a7560aae08cca52b63: done: 0.138085 sec","job_status":"done","queue_duration_s":0.675268,"scheduling_latency_s":0.675319,"redis_calls":7,"redis_duration_s":0.007388,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006246,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001142,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02734,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.138085,"completed_at":"2026-08-16T16:47:07.496Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1399gitlab # [ 268.692683] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:07.500Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"8bae7c45f97a877117610708","created_at":"2026-08-16T16:47:06.716Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"773bad3f619e123fa59867d193015322","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-16T16:47:06.728Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-8bae7c45f97a877117610708: start","job_status":"start","queue_duration_s":0.771439,"scheduling_latency_s":0.77149}1400gitlab # [ 268.709685] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:07.518Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1401gitlab # [ 268.714524] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:07.529Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"8bae7c45f97a877117610708","created_at":"2026-08-16T16:47:06.716Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"773bad3f619e123fa59867d193015322","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-16T16:47:06.728Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-8bae7c45f97a877117610708: done: 0.029281 sec","job_status":"done","queue_duration_s":0.771439,"scheduling_latency_s":0.77149,"redis_calls":7,"redis_duration_s":0.0024200000000000003,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001744,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000676,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018367,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029281,"completed_at":"2026-08-16T16:47:07.529Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1402gitlab # [ 268.758824] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:07.531Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"37be1f473ccb3677bc5cd539","created_at":"2026-08-16T16:47:06.752Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"40c4a47bde0b46b6f8426ec7d92660ae","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-16T16:47:06.758Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-37be1f473ccb3677bc5cd539: start","job_status":"start","queue_duration_s":0.772927,"scheduling_latency_s":0.772957}1403gitlab # [ 268.773897] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:07.555Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"37be1f473ccb3677bc5cd539","created_at":"2026-08-16T16:47:06.752Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"40c4a47bde0b46b6f8426ec7d92660ae","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-16T16:47:06.758Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-37be1f473ccb3677bc5cd539: done: 0.023262 sec","job_status":"done","queue_duration_s":0.772927,"scheduling_latency_s":0.772957,"redis_calls":8,"redis_duration_s":0.002303,"redis_read_bytes":133,"redis_write_bytes":846,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000265,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":70,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001475,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000563,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014093,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023262,"completed_at":"2026-08-16T16:47:07.555Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404gitlab # [ 268.816927] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:07.557Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"83a27d62a825661814693797","created_at":"2026-08-16T16:47:06.810Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"434b3c2d0480e5ccb56a93c893216788","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-16T16:47:06.820Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-83a27d62a825661814693797: start","job_status":"start","queue_duration_s":0.737244,"scheduling_latency_s":0.737267}1405gitlab # [ 268.832804] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:07.652Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"83a27d62a825661814693797","created_at":"2026-08-16T16:47:06.810Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"434b3c2d0480e5ccb56a93c893216788","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-16T16:47:06.820Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-83a27d62a825661814693797: done: 0.094029 sec","job_status":"done","queue_duration_s":0.737244,"scheduling_latency_s":0.737267,"redis_calls":9,"redis_duration_s":0.003493,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001856,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001637,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.044,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.044,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037783,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00103712,"exclusive_lock_hold_duration_s":0.04079748,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.094029,"completed_at":"2026-08-16T16:47:07.651Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.045533,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1406gitlab # [ 268.875985] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:07.656Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"7c6fcc7c4a363db4aae72c0e","created_at":"2026-08-16T16:47:06.880Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bc24563a131972a223cbfa29e913721b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-16T16:47:06.890Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-7c6fcc7c4a363db4aae72c0e: start","job_status":"start","queue_duration_s":0.7654,"scheduling_latency_s":0.765444}1407gitlab # [ 268.890206] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:07.772Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"7c6fcc7c4a363db4aae72c0e","created_at":"2026-08-16T16:47:06.880Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bc24563a131972a223cbfa29e913721b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-16T16:47:06.890Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-7c6fcc7c4a363db4aae72c0e: done: 0.116865 sec","job_status":"done","queue_duration_s":0.7654,"scheduling_latency_s":0.765444,"redis_calls":9,"redis_duration_s":0.0038259999999999995,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002021,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001805,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.033,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.033,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055972,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00101758,"exclusive_lock_hold_duration_s":0.08225246,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.116865,"completed_at":"2026-08-16T16:47:07.772Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.063365,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1408gitlab # [ 268.933229] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:07.775Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"696ea3243167fb7283309e90","created_at":"2026-08-16T16:47:06.918Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a29a14dd7f2887411f67f8c72eecfd1a","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-16T16:47:06.928Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-696ea3243167fb7283309e90: start","job_status":"start","queue_duration_s":0.847434,"scheduling_latency_s":0.847471}1409gitlab # [ 268.947219] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:07.826Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"696ea3243167fb7283309e90","created_at":"2026-08-16T16:47:06.918Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a29a14dd7f2887411f67f8c72eecfd1a","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-16T16:47:06.928Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-696ea3243167fb7283309e90: done: 0.050282 sec","job_status":"done","queue_duration_s":0.847434,"scheduling_latency_s":0.847471,"redis_calls":8,"redis_duration_s":0.003242,"redis_read_bytes":133,"redis_write_bytes":875,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000303,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":49,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002096,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000843,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022663,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.050282,"completed_at":"2026-08-16T16:47:07.826Z","load_balancing_strategy":"primary","db_duration_s":0.016999,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1410gitlab # [ 268.989628] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:07.829Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"f63096c16b96ef8acb987041","created_at":"2026-08-16T16:47:06.958Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6ac610f07bda6d433e1579ccd53c902f","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-16T16:47:06.973Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-f63096c16b96ef8acb987041: start","job_status":"start","queue_duration_s":0.855894,"scheduling_latency_s":0.855934}1411gitlab # [ 269.004216] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:07.874Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"f63096c16b96ef8acb987041","created_at":"2026-08-16T16:47:06.958Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6ac610f07bda6d433e1579ccd53c902f","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-16T16:47:06.973Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-f63096c16b96ef8acb987041: done: 0.045084 sec","job_status":"done","queue_duration_s":0.855894,"scheduling_latency_s":0.855934,"redis_calls":10,"redis_duration_s":0.003915999999999999,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002394,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001522,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028838,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00893286,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.045084,"completed_at":"2026-08-16T16:47:07.874Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004059,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1412gitlab # [ 269.047808] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:07.876Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"3b9c5689aebe9d4405cf6981","created_at":"2026-08-16T16:47:06.993Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6d83beb4d239e223d50e0fbdf481d225","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.003Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-3b9c5689aebe9d4405cf6981: start","job_status":"start","queue_duration_s":0.873391,"scheduling_latency_s":0.873422}1413gitlab # [ 269.062166] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:07.903Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"3b9c5689aebe9d4405cf6981","created_at":"2026-08-16T16:47:06.993Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6d83beb4d239e223d50e0fbdf481d225","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.003Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-3b9c5689aebe9d4405cf6981: done: 0.027069 sec","job_status":"done","queue_duration_s":0.873391,"scheduling_latency_s":0.873422,"redis_calls":9,"redis_duration_s":0.002889,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001553,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001336,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017034,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0008217,"exclusive_lock_hold_duration_s":0.00429048,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.027069,"completed_at":"2026-08-16T16:47:07.903Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001976,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1414gitlab # [ 269.103626] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:07.906Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"941fab747bd9e63ac8f647b9","created_at":"2026-08-16T16:47:07.032Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8e3f0281bdd930bb5caa6a7effd6a370","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.042Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-941fab747bd9e63ac8f647b9: start","job_status":"start","queue_duration_s":0.863383,"scheduling_latency_s":0.863411}1415gitlab # [ 269.118452] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:07.919Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1416gitlab # [ 269.122344] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:07.926Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"941fab747bd9e63ac8f647b9","created_at":"2026-08-16T16:47:07.032Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8e3f0281bdd930bb5caa6a7effd6a370","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.042Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-941fab747bd9e63ac8f647b9: done: 0.020425 sec","job_status":"done","queue_duration_s":0.863383,"scheduling_latency_s":0.863411,"redis_calls":7,"redis_duration_s":0.002003,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001441,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000562,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013051,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020425,"completed_at":"2026-08-16T16:47:07.926Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1417gitlab # [ 269.162848] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:07.928Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"c0c48775639f0b18856d14d3","created_at":"2026-08-16T16:47:07.068Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b5012a95da217ca13179bab571025e63","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.077Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-c0c48775639f0b18856d14d3: start","job_status":"start","queue_duration_s":0.850529,"scheduling_latency_s":0.850553}1418gitlab # [ 269.177005] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:07.948Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"c0c48775639f0b18856d14d3","created_at":"2026-08-16T16:47:07.068Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b5012a95da217ca13179bab571025e63","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.077Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-c0c48775639f0b18856d14d3: done: 0.020045 sec","job_status":"done","queue_duration_s":0.850529,"scheduling_latency_s":0.850553,"redis_calls":7,"redis_duration_s":0.001866,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001354,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000512,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011198,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020045,"completed_at":"2026-08-16T16:47:07.948Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001813,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1419gitlab # [ 269.217111] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:07.950Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"5abc864504ca69346f2d37bd","created_at":"2026-08-16T16:47:07.097Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6f76b5c4f91334cc2d362799baab7386","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-16T16:47:07.106Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-5abc864504ca69346f2d37bd: start","job_status":"start","queue_duration_s":0.843521,"scheduling_latency_s":0.843543}1420gitlab # [ 269.230078] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:07.977Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"5abc864504ca69346f2d37bd","created_at":"2026-08-16T16:47:07.097Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6f76b5c4f91334cc2d362799baab7386","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-16T16:47:07.106Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-5abc864504ca69346f2d37bd: done: 0.027082 sec","job_status":"done","queue_duration_s":0.843521,"scheduling_latency_s":0.843543,"redis_calls":7,"redis_duration_s":0.001962,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001429,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000533,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017418,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027082,"completed_at":"2026-08-16T16:47:07.977Z","load_balancing_strategy":"primary","db_duration_s":0.002914,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1421gitlab # [ 269.270251] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:07.979Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"e4cc641acd51641e22e22545","created_at":"2026-08-16T16:47:07.155Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"454086d6c23c13a4da427b47acabc3de","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.165Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-e4cc641acd51641e22e22545: start","job_status":"start","queue_duration_s":0.813975,"scheduling_latency_s":0.813995}1422gitlab # [ 269.283676] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.010Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"e4cc641acd51641e22e22545","created_at":"2026-08-16T16:47:07.155Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"454086d6c23c13a4da427b47acabc3de","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.165Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-e4cc641acd51641e22e22545: done: 0.031578 sec","job_status":"done","queue_duration_s":0.813975,"scheduling_latency_s":0.813995,"redis_calls":14,"redis_duration_s":0.003631,"redis_read_bytes":16,"redis_write_bytes":4030,"redis_queues_calls":2,"redis_queues_duration_s":0.000443,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002314,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000874,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022984,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031578,"completed_at":"2026-08-16T16:47:08.010Z","load_balancing_strategy":"primary","db_duration_s":0.002058,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1423gitlab # [ 269.324660] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.012Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"3b1d5375bad002f2151b23ed","created_at":"2026-08-16T16:47:07.185Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a3204375600aff1d0d0e0bbcc87f2cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.194Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-3b1d5375bad002f2151b23ed: start","job_status":"start","queue_duration_s":0.817768,"scheduling_latency_s":0.817787}1424gitlab # [ 269.338255] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.045Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"3b1d5375bad002f2151b23ed","created_at":"2026-08-16T16:47:07.185Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a3204375600aff1d0d0e0bbcc87f2cb1","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.194Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-3b1d5375bad002f2151b23ed: done: 0.033783 sec","job_status":"done","queue_duration_s":0.817768,"scheduling_latency_s":0.817787,"redis_calls":9,"redis_duration_s":0.003299,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001777,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001522,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02462,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00121648,"exclusive_lock_hold_duration_s":0.00649038,"duration_s":0.033783,"completed_at":"2026-08-16T16:47:08.045Z","load_balancing_strategy":"primary","db_duration_s":0.00183,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1425gitlab # [ 269.377919] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.047Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"c099483f1d3305f0c9eb5f85","created_at":"2026-08-16T16:47:07.219Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"33ced7968e02f22436b2cd68126b5520","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.228Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-c099483f1d3305f0c9eb5f85: start","job_status":"start","queue_duration_s":0.818767,"scheduling_latency_s":0.818791}1426gitlab # [ 269.392213] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.058Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1427gitlab # [ 269.395209] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.064Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"c099483f1d3305f0c9eb5f85","created_at":"2026-08-16T16:47:07.219Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"33ced7968e02f22436b2cd68126b5520","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.228Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-c099483f1d3305f0c9eb5f85: done: 0.016957 sec","job_status":"done","queue_duration_s":0.818767,"scheduling_latency_s":0.818791,"redis_calls":7,"redis_duration_s":0.001827,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001315,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000512,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010001,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016957,"completed_at":"2026-08-16T16:47:08.064Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1428gitlab # [ 269.435628] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.067Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"0d1df12fd2e90680f782a961","created_at":"2026-08-16T16:47:07.270Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"84e35c2c360793937ec704da8dab8e85","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.280Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-0d1df12fd2e90680f782a961: start","job_status":"start","queue_duration_s":0.787351,"scheduling_latency_s":0.7874}1429gitlab # [ 269.450882] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.110Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"0d1df12fd2e90680f782a961","created_at":"2026-08-16T16:47:07.270Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"84e35c2c360793937ec704da8dab8e85","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.280Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-0d1df12fd2e90680f782a961: done: 0.043604 sec","job_status":"done","queue_duration_s":0.787351,"scheduling_latency_s":0.7874,"redis_calls":7,"redis_duration_s":0.002802,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002123,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000679,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025337,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.043604,"completed_at":"2026-08-16T16:47:08.110Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006644,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1430gitlab # [ 269.491035] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.113Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"450e5767d11309f059e2d35f","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-450e5767d11309f059e2d35f: start","job_status":"start","queue_duration_s":0.826175,"scheduling_latency_s":0.826207}1431gitlab # [ 269.503550] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.153Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"450e5767d11309f059e2d35f","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-450e5767d11309f059e2d35f: done: 0.040446 sec","job_status":"done","queue_duration_s":0.826175,"scheduling_latency_s":0.826207,"redis_calls":13,"redis_duration_s":0.005223,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001628,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003595,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02904,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.040446,"completed_at":"2026-08-16T16:47:08.153Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1432gitlab # [ 269.543367] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.156Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"21b0c78c1218762e008f34c3","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-21b0c78c1218762e008f34c3: start","job_status":"start","queue_duration_s":0.869239,"scheduling_latency_s":0.869278}1433gitlab # [ 269.556069] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.185Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"21b0c78c1218762e008f34c3","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-21b0c78c1218762e008f34c3: done: 0.028784 sec","job_status":"done","queue_duration_s":0.869239,"scheduling_latency_s":0.869278,"redis_calls":13,"redis_duration_s":0.003609,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001222,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002387,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019158,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028784,"completed_at":"2026-08-16T16:47:08.185Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1434gitlab # [ 269.595572] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.187Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af5f33efd4de7c2dc88eab50","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af5f33efd4de7c2dc88eab50: start","job_status":"start","queue_duration_s":0.899901,"scheduling_latency_s":0.899931}1435gitlab # [ 269.608194] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.208Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af5f33efd4de7c2dc88eab50","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af5f33efd4de7c2dc88eab50: done: 0.021536 sec","job_status":"done","queue_duration_s":0.899901,"scheduling_latency_s":0.899931,"redis_calls":13,"redis_duration_s":0.00309,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001122,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001968,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014144,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021536,"completed_at":"2026-08-16T16:47:08.208Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1436gitlab # [ 269.648779] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.212Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abfe1e57ba44bdcd4b2f2914","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abfe1e57ba44bdcd4b2f2914: start","job_status":"start","queue_duration_s":0.923828,"scheduling_latency_s":0.925119}1437gitlab # [ 269.661345] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.252Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abfe1e57ba44bdcd4b2f2914","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abfe1e57ba44bdcd4b2f2914: done: 0.041428 sec","job_status":"done","queue_duration_s":0.923828,"scheduling_latency_s":0.925119,"redis_calls":13,"redis_duration_s":0.005256,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001625,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003631,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02723,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.041428,"completed_at":"2026-08-16T16:47:08.252Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1438gitlab # [ 269.701149] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.255Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"60e0136307755a5381ec77ce","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-60e0136307755a5381ec77ce: start","job_status":"start","queue_duration_s":0.968105,"scheduling_latency_s":0.968146}1439gitlab # [ 269.713732] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.284Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"60e0136307755a5381ec77ce","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-60e0136307755a5381ec77ce: done: 0.028984 sec","job_status":"done","queue_duration_s":0.968105,"scheduling_latency_s":0.968146,"redis_calls":13,"redis_duration_s":0.003591,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001192,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002399,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019096,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028984,"completed_at":"2026-08-16T16:47:08.284Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1440gitlab # [ 269.753564] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.286Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37dadac1df0e35715e7ee55a","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37dadac1df0e35715e7ee55a: start","job_status":"start","queue_duration_s":0.999133,"scheduling_latency_s":0.999165}1441gitlab # [ 269.766876] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.307Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37dadac1df0e35715e7ee55a","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37dadac1df0e35715e7ee55a: done: 0.021451 sec","job_status":"done","queue_duration_s":0.999133,"scheduling_latency_s":0.999165,"redis_calls":13,"redis_duration_s":0.003121,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001033,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002088,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01383,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021451,"completed_at":"2026-08-16T16:47:08.307Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1442gitlab # [ 269.807738] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.309Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"29049139a6fdd102d114025f","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-29049139a6fdd102d114025f: start","job_status":"start","queue_duration_s":1.022126,"scheduling_latency_s":1.022146}1443gitlab # [ 269.821019] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.329Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"29049139a6fdd102d114025f","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-29049139a6fdd102d114025f: done: 0.01956 sec","job_status":"done","queue_duration_s":1.022126,"scheduling_latency_s":1.022146,"redis_calls":13,"redis_duration_s":0.0030489999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001004,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002045,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012007,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01956,"completed_at":"2026-08-16T16:47:08.328Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1444gitlab # [ 269.862112] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.330Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b581fca4d2cd3c7df4f2273","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b581fca4d2cd3c7df4f2273: start","job_status":"start","queue_duration_s":1.043273,"scheduling_latency_s":1.043292}1445gitlab # [ 269.874903] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.347Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b581fca4d2cd3c7df4f2273","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b581fca4d2cd3c7df4f2273: done: 0.017128 sec","job_status":"done","queue_duration_s":1.043273,"scheduling_latency_s":1.043292,"redis_calls":13,"redis_duration_s":0.002695,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000958,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001737,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011192,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017128,"completed_at":"2026-08-16T16:47:08.347Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1446gitlab # [ 269.915194] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.349Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e91bfe4294486fa6bc9ca67","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e91bfe4294486fa6bc9ca67: start","job_status":"start","queue_duration_s":1.061753,"scheduling_latency_s":1.061772}1447gitlab # [ 269.928255] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.366Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e91bfe4294486fa6bc9ca67","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e91bfe4294486fa6bc9ca67: done: 0.017265 sec","job_status":"done","queue_duration_s":1.061753,"scheduling_latency_s":1.061772,"redis_calls":13,"redis_duration_s":0.002873,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000961,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001912,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011256,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017265,"completed_at":"2026-08-16T16:47:08.366Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1448gitlab # [ 269.968135] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.367Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"72132c1ca7df0b6a3cb0e7db","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-72132c1ca7df0b6a3cb0e7db: start","job_status":"start","queue_duration_s":1.080528,"scheduling_latency_s":1.080545}1449gitlab # [ 269.980526] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.384Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"72132c1ca7df0b6a3cb0e7db","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-72132c1ca7df0b6a3cb0e7db: done: 0.016919 sec","job_status":"done","queue_duration_s":1.080528,"scheduling_latency_s":1.080545,"redis_calls":13,"redis_duration_s":0.002866,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000924,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001942,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010044,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016919,"completed_at":"2026-08-16T16:47:08.384Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1450gitlab # [ 270.020604] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.386Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"709509b120f32a65f7fd2de9","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-709509b120f32a65f7fd2de9: start","job_status":"start","queue_duration_s":1.098736,"scheduling_latency_s":1.098751}1451gitlab # [ 270.033103] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.401Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"709509b120f32a65f7fd2de9","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-709509b120f32a65f7fd2de9: done: 0.015124 sec","job_status":"done","queue_duration_s":1.098736,"scheduling_latency_s":1.098751,"redis_calls":13,"redis_duration_s":0.0034460000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000903,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002543,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00968,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015124,"completed_at":"2026-08-16T16:47:08.401Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1452gitlab # [ 270.074033] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.402Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08af0bfa77c23cef327b2789","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08af0bfa77c23cef327b2789: start","job_status":"start","queue_duration_s":1.115179,"scheduling_latency_s":1.115195}1453gitlab # [ 270.086777] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.416Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08af0bfa77c23cef327b2789","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08af0bfa77c23cef327b2789: done: 0.014305 sec","job_status":"done","queue_duration_s":1.115179,"scheduling_latency_s":1.115195,"redis_calls":13,"redis_duration_s":0.001526,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000999,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010083,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014305,"completed_at":"2026-08-16T16:47:08.416Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1454gitlab # [ 270.126239] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.418Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fec593c5fa70d2eee5c66ba9","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fec593c5fa70d2eee5c66ba9: start","job_status":"start","queue_duration_s":1.130663,"scheduling_latency_s":1.130682}1455gitlab # [ 270.138774] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.433Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fec593c5fa70d2eee5c66ba9","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fec593c5fa70d2eee5c66ba9: done: 0.015224 sec","job_status":"done","queue_duration_s":1.130663,"scheduling_latency_s":1.130682,"redis_calls":13,"redis_duration_s":0.001462,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000911,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010215,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015224,"completed_at":"2026-08-16T16:47:08.433Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1456gitlab # [ 270.177774] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.434Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f79024e34486a3f6a050048","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f79024e34486a3f6a050048: start","job_status":"start","queue_duration_s":1.14694,"scheduling_latency_s":1.146957}1457gitlab # [ 270.190190] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.448Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f79024e34486a3f6a050048","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f79024e34486a3f6a050048: done: 0.014663 sec","job_status":"done","queue_duration_s":1.14694,"scheduling_latency_s":1.146957,"redis_calls":13,"redis_duration_s":0.0014399999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000498,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000942,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010295,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014663,"completed_at":"2026-08-16T16:47:08.448Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1458gitlab # [ 270.229448] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.450Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b05cae8d9b73398fb7c85ad","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b05cae8d9b73398fb7c85ad: start","job_status":"start","queue_duration_s":1.162638,"scheduling_latency_s":1.162655}1459gitlab # [ 270.241643] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.464Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b05cae8d9b73398fb7c85ad","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b05cae8d9b73398fb7c85ad: done: 0.014681 sec","job_status":"done","queue_duration_s":1.162638,"scheduling_latency_s":1.162655,"redis_calls":13,"redis_duration_s":0.002399,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001462,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000937,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010548,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014681,"completed_at":"2026-08-16T16:47:08.464Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1460gitlab # [ 270.281699] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.465Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"93314dfa395e4b6c342b5546","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-93314dfa395e4b6c342b5546: start","job_status":"start","queue_duration_s":1.178381,"scheduling_latency_s":1.1784}1461gitlab # [ 270.294289] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.496Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"93314dfa395e4b6c342b5546","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-93314dfa395e4b6c342b5546: done: 0.030306 sec","job_status":"done","queue_duration_s":1.178381,"scheduling_latency_s":1.1784,"redis_calls":13,"redis_duration_s":0.001389,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000502,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000887,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009828,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030306,"completed_at":"2026-08-16T16:47:08.495Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1462gitlab # [ 270.333495] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.497Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"949d4650dbcad570badd211b","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-949d4650dbcad570badd211b: start","job_status":"start","queue_duration_s":1.209761,"scheduling_latency_s":1.20978}1463gitlab # [ 270.345828] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.511Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"949d4650dbcad570badd211b","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-949d4650dbcad570badd211b: done: 0.014047 sec","job_status":"done","queue_duration_s":1.209761,"scheduling_latency_s":1.20978,"redis_calls":13,"redis_duration_s":0.00143,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00093,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009817,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014047,"completed_at":"2026-08-16T16:47:08.511Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1464gitlab # [ 270.384354] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.512Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33776c29accd01710a1bf4f2","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33776c29accd01710a1bf4f2: start","job_status":"start","queue_duration_s":1.224847,"scheduling_latency_s":1.224865}1465gitlab # [ 270.396387] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.526Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33776c29accd01710a1bf4f2","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33776c29accd01710a1bf4f2: done: 0.01387 sec","job_status":"done","queue_duration_s":1.224847,"scheduling_latency_s":1.224865,"redis_calls":13,"redis_duration_s":0.0013679999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000495,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000873,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009742,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01387,"completed_at":"2026-08-16T16:47:08.526Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1466gitlab # [ 270.435684] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.527Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"445efb6f169a9d215ee22f48","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-445efb6f169a9d215ee22f48: start","job_status":"start","queue_duration_s":1.240211,"scheduling_latency_s":1.24023}1467gitlab # [ 270.448323] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.541Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"445efb6f169a9d215ee22f48","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-445efb6f169a9d215ee22f48: done: 0.014415 sec","job_status":"done","queue_duration_s":1.240211,"scheduling_latency_s":1.24023,"redis_calls":13,"redis_duration_s":0.001422,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000888,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009934,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014415,"completed_at":"2026-08-16T16:47:08.541Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1468gitlab # [ 270.488557] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.543Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad4bab9bfe60538b70bdf29b","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad4bab9bfe60538b70bdf29b: start","job_status":"start","queue_duration_s":1.255701,"scheduling_latency_s":1.255719}1469gitlab # [ 270.500962] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.557Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad4bab9bfe60538b70bdf29b","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad4bab9bfe60538b70bdf29b: done: 0.014113 sec","job_status":"done","queue_duration_s":1.255701,"scheduling_latency_s":1.255719,"redis_calls":13,"redis_duration_s":0.001422,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000905,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009917,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014113,"completed_at":"2026-08-16T16:47:08.557Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1470gitlab # [ 270.540190] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.558Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c96235922a0795a505f8974f","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c96235922a0795a505f8974f: start","job_status":"start","queue_duration_s":1.270859,"scheduling_latency_s":1.270877}1471gitlab # [ 270.552506] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.572Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c96235922a0795a505f8974f","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c96235922a0795a505f8974f: done: 0.013948 sec","job_status":"done","queue_duration_s":1.270859,"scheduling_latency_s":1.270877,"redis_calls":13,"redis_duration_s":0.001422,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000906,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009771,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013948,"completed_at":"2026-08-16T16:47:08.572Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1472gitlab # [ 270.591634] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.573Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ba8e60e7b6f57415dcc95539","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ba8e60e7b6f57415dcc95539: start","job_status":"start","queue_duration_s":1.285862,"scheduling_latency_s":1.285879}1473gitlab # [ 270.604374] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.588Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ba8e60e7b6f57415dcc95539","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ba8e60e7b6f57415dcc95539: done: 0.014914 sec","job_status":"done","queue_duration_s":1.285862,"scheduling_latency_s":1.285879,"redis_calls":13,"redis_duration_s":0.001362,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000503,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000859,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00917,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014914,"completed_at":"2026-08-16T16:47:08.588Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1474gitlab # [ 270.643226] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.589Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2705b793b23049c8e16cfa2a","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2705b793b23049c8e16cfa2a: start","job_status":"start","queue_duration_s":1.301838,"scheduling_latency_s":1.301856}1475gitlab # [ 270.655876] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.604Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2705b793b23049c8e16cfa2a","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2705b793b23049c8e16cfa2a: done: 0.015187 sec","job_status":"done","queue_duration_s":1.301838,"scheduling_latency_s":1.301856,"redis_calls":13,"redis_duration_s":0.001428,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000877,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010149,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015187,"completed_at":"2026-08-16T16:47:08.604Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1476gitlab # [ 270.696702] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.605Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"294ef3b935012d524f3f1c51","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-294ef3b935012d524f3f1c51: start","job_status":"start","queue_duration_s":1.318084,"scheduling_latency_s":1.318101}1477gitlab # [ 270.708926] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.619Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"294ef3b935012d524f3f1c51","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-294ef3b935012d524f3f1c51: done: 0.013894 sec","job_status":"done","queue_duration_s":1.318084,"scheduling_latency_s":1.318101,"redis_calls":13,"redis_duration_s":0.00141,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000866,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009695,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013894,"completed_at":"2026-08-16T16:47:08.619Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1478gitlab # [ 270.748323] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.620Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e934f5fd3e4d1ed33a2a3339","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e934f5fd3e4d1ed33a2a3339: start","job_status":"start","queue_duration_s":1.333038,"scheduling_latency_s":1.333055}1479gitlab # [ 270.760346] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.634Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e934f5fd3e4d1ed33a2a3339","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e934f5fd3e4d1ed33a2a3339: done: 0.013869 sec","job_status":"done","queue_duration_s":1.333038,"scheduling_latency_s":1.333055,"redis_calls":13,"redis_duration_s":0.001368,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000496,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000872,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009286,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013869,"completed_at":"2026-08-16T16:47:08.634Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1480gitlab # [ 270.800242] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.635Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"063e8a62f1c0d92308375938","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-063e8a62f1c0d92308375938: start","job_status":"start","queue_duration_s":1.348349,"scheduling_latency_s":1.348367}1481gitlab # [ 270.812714] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.650Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"063e8a62f1c0d92308375938","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-063e8a62f1c0d92308375938: done: 0.014824 sec","job_status":"done","queue_duration_s":1.348349,"scheduling_latency_s":1.348367,"redis_calls":13,"redis_duration_s":0.001643,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001108,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010243,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014824,"completed_at":"2026-08-16T16:47:08.650Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1482gitlab # [ 270.852464] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.651Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e84988c4c1f52ec02169775","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e84988c4c1f52ec02169775: start","job_status":"start","queue_duration_s":1.36426,"scheduling_latency_s":1.364279}1483gitlab # [ 270.865762] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.666Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e84988c4c1f52ec02169775","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e84988c4c1f52ec02169775: done: 0.015114 sec","job_status":"done","queue_duration_s":1.36426,"scheduling_latency_s":1.364279,"redis_calls":13,"redis_duration_s":0.0014529999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000556,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000897,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01044,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015114,"completed_at":"2026-08-16T16:47:08.666Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1484gitlab # [ 270.904813] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.667Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b3996dc27760b0ab988556b","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b3996dc27760b0ab988556b: start","job_status":"start","queue_duration_s":1.380503,"scheduling_latency_s":1.380522}1485gitlab # [ 270.916978] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.682Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b3996dc27760b0ab988556b","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b3996dc27760b0ab988556b: done: 0.014751 sec","job_status":"done","queue_duration_s":1.380503,"scheduling_latency_s":1.380522,"redis_calls":13,"redis_duration_s":0.001584,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000562,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001022,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009777,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014751,"completed_at":"2026-08-16T16:47:08.682Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1486gitlab # [ 270.956628] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.683Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c5a87981b23fddf5b34d70db","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c5a87981b23fddf5b34d70db: start","job_status":"start","queue_duration_s":1.396526,"scheduling_latency_s":1.396543}1487gitlab # [ 270.969140] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.697Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c5a87981b23fddf5b34d70db","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c5a87981b23fddf5b34d70db: done: 0.013804 sec","job_status":"done","queue_duration_s":1.396526,"scheduling_latency_s":1.396543,"redis_calls":13,"redis_duration_s":0.001423,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009654,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013804,"completed_at":"2026-08-16T16:47:08.697Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1488gitlab # [ 271.008244] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.698Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b43a52a80602a0c083573c57","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b43a52a80602a0c083573c57: start","job_status":"start","queue_duration_s":1.411454,"scheduling_latency_s":1.411471}1489gitlab # [ 271.020381] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.712Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b43a52a80602a0c083573c57","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b43a52a80602a0c083573c57: done: 0.013605 sec","job_status":"done","queue_duration_s":1.411454,"scheduling_latency_s":1.411471,"redis_calls":13,"redis_duration_s":0.001393,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000886,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009454,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013605,"completed_at":"2026-08-16T16:47:08.712Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1490gitlab # [ 271.059389] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.713Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"50aa0dd9fe46d06e8a93bed8","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-50aa0dd9fe46d06e8a93bed8: start","job_status":"start","queue_duration_s":1.4261,"scheduling_latency_s":1.426117}1491gitlab # [ 271.072718] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.727Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"50aa0dd9fe46d06e8a93bed8","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-50aa0dd9fe46d06e8a93bed8: done: 0.013856 sec","job_status":"done","queue_duration_s":1.4261,"scheduling_latency_s":1.426117,"redis_calls":13,"redis_duration_s":0.001428,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000905,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009538,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013856,"completed_at":"2026-08-16T16:47:08.727Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1492gitlab # [ 271.113023] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.728Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"403a0cf36b80d799afae8d91","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-403a0cf36b80d799afae8d91: start","job_status":"start","queue_duration_s":1.441007,"scheduling_latency_s":1.441025}1493gitlab # [ 271.125846] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.741Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"403a0cf36b80d799afae8d91","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-403a0cf36b80d799afae8d91: done: 0.013575 sec","job_status":"done","queue_duration_s":1.441007,"scheduling_latency_s":1.441025,"redis_calls":13,"redis_duration_s":0.001423,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00088,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009407,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013575,"completed_at":"2026-08-16T16:47:08.741Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1494gitlab # [ 271.166048] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.743Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"35b7dfaf903e87661bd6cd5b","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-35b7dfaf903e87661bd6cd5b: start","job_status":"start","queue_duration_s":1.455886,"scheduling_latency_s":1.455904}1495gitlab # [ 271.178808] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.756Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"35b7dfaf903e87661bd6cd5b","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-35b7dfaf903e87661bd6cd5b: done: 0.013529 sec","job_status":"done","queue_duration_s":1.455886,"scheduling_latency_s":1.455904,"redis_calls":13,"redis_duration_s":0.0014290000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000557,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000872,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009375,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013529,"completed_at":"2026-08-16T16:47:08.756Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1496gitlab # [ 271.218766] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.757Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be60a09a96ab4300c749854a","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be60a09a96ab4300c749854a: start","job_status":"start","queue_duration_s":1.470484,"scheduling_latency_s":1.470501}1497gitlab # [ 271.231564] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.771Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be60a09a96ab4300c749854a","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be60a09a96ab4300c749854a: done: 0.013644 sec","job_status":"done","queue_duration_s":1.470484,"scheduling_latency_s":1.470501,"redis_calls":13,"redis_duration_s":0.001389,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00088,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009387,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013644,"completed_at":"2026-08-16T16:47:08.771Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1498gitlab # [ 271.271442] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.772Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"180feb0d870ef13016baf204","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-180feb0d870ef13016baf204: start","job_status":"start","queue_duration_s":1.485299,"scheduling_latency_s":1.485315}1499gitlab # [ 271.285010] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.786Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"180feb0d870ef13016baf204","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-180feb0d870ef13016baf204: done: 0.01361 sec","job_status":"done","queue_duration_s":1.485299,"scheduling_latency_s":1.485315,"redis_calls":13,"redis_duration_s":0.0013830000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000873,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009343,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01361,"completed_at":"2026-08-16T16:47:08.786Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1500gitlab # [ 271.324164] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.787Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"22469c50f35adc2bb553908f","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-22469c50f35adc2bb553908f: start","job_status":"start","queue_duration_s":1.499971,"scheduling_latency_s":1.499989}1501gitlab # [ 271.336133] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.800Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"22469c50f35adc2bb553908f","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-22469c50f35adc2bb553908f: done: 0.013562 sec","job_status":"done","queue_duration_s":1.499971,"scheduling_latency_s":1.499989,"redis_calls":13,"redis_duration_s":0.001373,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000487,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000886,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009439,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013562,"completed_at":"2026-08-16T16:47:08.800Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1502gitlab # [ 271.375041] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.801Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c40d88425e78211b9a789485","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c40d88425e78211b9a789485: start","job_status":"start","queue_duration_s":1.514603,"scheduling_latency_s":1.51462}1503gitlab # [ 271.387569] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.815Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c40d88425e78211b9a789485","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c40d88425e78211b9a789485: done: 0.013759 sec","job_status":"done","queue_duration_s":1.514603,"scheduling_latency_s":1.51462,"redis_calls":13,"redis_duration_s":0.001441,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00093,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009441,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013759,"completed_at":"2026-08-16T16:47:08.815Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1504gitlab # [ 271.426430] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.816Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ea37ea9e5e3feff7ce250a0","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ea37ea9e5e3feff7ce250a0: start","job_status":"start","queue_duration_s":1.529417,"scheduling_latency_s":1.529434}1505gitlab # [ 271.438930] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.830Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ea37ea9e5e3feff7ce250a0","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ea37ea9e5e3feff7ce250a0: done: 0.013613 sec","job_status":"done","queue_duration_s":1.529417,"scheduling_latency_s":1.529434,"redis_calls":13,"redis_duration_s":0.001373,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000864,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009402,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013613,"completed_at":"2026-08-16T16:47:08.830Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1506gitlab # [ 271.479232] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.831Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51d04262003cb813f769c575","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51d04262003cb813f769c575: start","job_status":"start","queue_duration_s":1.544152,"scheduling_latency_s":1.54417}1507gitlab # [ 271.491535] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.845Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51d04262003cb813f769c575","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51d04262003cb813f769c575: done: 0.013774 sec","job_status":"done","queue_duration_s":1.544152,"scheduling_latency_s":1.54417,"redis_calls":13,"redis_duration_s":0.001359,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000493,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000866,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009351,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013774,"completed_at":"2026-08-16T16:47:08.845Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1508gitlab # [ 271.530684] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.846Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a917a190655e404420c9810e","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a917a190655e404420c9810e: start","job_status":"start","queue_duration_s":1.559028,"scheduling_latency_s":1.559045}1509gitlab # [ 271.543059] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.860Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a917a190655e404420c9810e","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a917a190655e404420c9810e: done: 0.013773 sec","job_status":"done","queue_duration_s":1.559028,"scheduling_latency_s":1.559045,"redis_calls":13,"redis_duration_s":0.001447,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000933,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009567,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013773,"completed_at":"2026-08-16T16:47:08.860Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1510gitlab # [ 271.581998] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.861Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"30ea0e1ee7a005538f1aab56","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-30ea0e1ee7a005538f1aab56: start","job_status":"start","queue_duration_s":1.573845,"scheduling_latency_s":1.573862}1511gitlab # [ 271.594453] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.874Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"30ea0e1ee7a005538f1aab56","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-30ea0e1ee7a005538f1aab56: done: 0.013602 sec","job_status":"done","queue_duration_s":1.573845,"scheduling_latency_s":1.573862,"redis_calls":13,"redis_duration_s":0.001389,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000885,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009246,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013602,"completed_at":"2026-08-16T16:47:08.874Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1512gitlab # [ 271.633242] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.875Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63997fef275ffd904f1354e1","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63997fef275ffd904f1354e1: start","job_status":"start","queue_duration_s":1.588495,"scheduling_latency_s":1.588512}1513gitlab # [ 271.645390] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.889Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63997fef275ffd904f1354e1","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63997fef275ffd904f1354e1: done: 0.013548 sec","job_status":"done","queue_duration_s":1.588495,"scheduling_latency_s":1.588512,"redis_calls":13,"redis_duration_s":0.001412,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000902,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009437,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013548,"completed_at":"2026-08-16T16:47:08.889Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1514gitlab # [ 271.685316] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.890Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70845ff461f2fced4d964976","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70845ff461f2fced4d964976: start","job_status":"start","queue_duration_s":1.603217,"scheduling_latency_s":1.603235}1515gitlab # [ 271.697728] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.904Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70845ff461f2fced4d964976","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70845ff461f2fced4d964976: done: 0.013653 sec","job_status":"done","queue_duration_s":1.603217,"scheduling_latency_s":1.603235,"redis_calls":13,"redis_duration_s":0.001381,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000876,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009429,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013653,"completed_at":"2026-08-16T16:47:08.904Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1516gitlab # [ 271.736283] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.905Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7bfa5352d9ceba99c82f6b49","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7bfa5352d9ceba99c82f6b49: start","job_status":"start","queue_duration_s":1.617895,"scheduling_latency_s":1.617912}1517gitlab # [ 271.748443] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.918Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7bfa5352d9ceba99c82f6b49","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7bfa5352d9ceba99c82f6b49: done: 0.013532 sec","job_status":"done","queue_duration_s":1.617895,"scheduling_latency_s":1.617912,"redis_calls":13,"redis_duration_s":0.001382,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000861,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00929,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013532,"completed_at":"2026-08-16T16:47:08.918Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1518gitlab # [ 271.788132] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.919Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"75fbb9a75021a1ae0178a8ff","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-75fbb9a75021a1ae0178a8ff: start","job_status":"start","queue_duration_s":1.632563,"scheduling_latency_s":1.632581}1519gitlab # [ 271.801062] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.933Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"75fbb9a75021a1ae0178a8ff","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-75fbb9a75021a1ae0178a8ff: done: 0.013567 sec","job_status":"done","queue_duration_s":1.632563,"scheduling_latency_s":1.632581,"redis_calls":13,"redis_duration_s":0.001405,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000885,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009435,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013567,"completed_at":"2026-08-16T16:47:08.933Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1520gitlab # [ 271.840387] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.934Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"25325e614a979d6b96c42e45","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-25325e614a979d6b96c42e45: start","job_status":"start","queue_duration_s":1.647293,"scheduling_latency_s":1.647311}1521gitlab # [ 271.853017] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.948Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"25325e614a979d6b96c42e45","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-25325e614a979d6b96c42e45: done: 0.013894 sec","job_status":"done","queue_duration_s":1.647293,"scheduling_latency_s":1.647311,"redis_calls":13,"redis_duration_s":0.00166,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000749,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000911,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009506,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013894,"completed_at":"2026-08-16T16:47:08.948Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1522gitlab # [ 271.893221] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.949Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"adec259a96534549c1f92633","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-adec259a96534549c1f92633: start","job_status":"start","queue_duration_s":1.662236,"scheduling_latency_s":1.662253}1523gitlab # [ 271.905657] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.963Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"adec259a96534549c1f92633","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-adec259a96534549c1f92633: done: 0.013554 sec","job_status":"done","queue_duration_s":1.662236,"scheduling_latency_s":1.662253,"redis_calls":13,"redis_duration_s":0.0014,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000494,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000906,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009412,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013554,"completed_at":"2026-08-16T16:47:08.963Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1524gitlab # [ 271.944851] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.964Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e1fe610f331511ca263a6d42","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e1fe610f331511ca263a6d42: start","job_status":"start","queue_duration_s":1.676857,"scheduling_latency_s":1.676874}1525gitlab # [ 271.957426] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.977Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e1fe610f331511ca263a6d42","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e1fe610f331511ca263a6d42: done: 0.013778 sec","job_status":"done","queue_duration_s":1.676857,"scheduling_latency_s":1.676874,"redis_calls":13,"redis_duration_s":0.0013909999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000879,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009423,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013778,"completed_at":"2026-08-16T16:47:08.977Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1526gitlab # [ 271.996941] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.979Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7cfabca6cec81348f927ddd7","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7cfabca6cec81348f927ddd7: start","job_status":"start","queue_duration_s":1.691688,"scheduling_latency_s":1.691704}1527gitlab # [ 272.009324] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.992Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7cfabca6cec81348f927ddd7","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7cfabca6cec81348f927ddd7: done: 0.013564 sec","job_status":"done","queue_duration_s":1.691688,"scheduling_latency_s":1.691704,"redis_calls":13,"redis_duration_s":0.001438,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000933,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009437,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013564,"completed_at":"2026-08-16T16:47:08.992Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1528gitlab # [ 272.048772] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:08.993Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b9d856bbbb1eeac931039c52","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b9d856bbbb1eeac931039c52: start","job_status":"start","queue_duration_s":1.706309,"scheduling_latency_s":1.706326}1529gitlab # [ 272.060991] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:09.007Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b9d856bbbb1eeac931039c52","created_at":"2026-08-16T16:47:06.782Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-be262d42d4c244f3","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa87ff3d324193375594c6517bcabfbb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.287Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b9d856bbbb1eeac931039c52: done: 0.013373 sec","job_status":"done","queue_duration_s":1.706309,"scheduling_latency_s":1.706326,"redis_calls":13,"redis_duration_s":0.001395,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000496,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000899,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009275,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013373,"completed_at":"2026-08-16T16:47:09.006Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1530gitlab # [ 272.101189] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:09.008Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"93e236fa9d4d0836f43b1ed3","created_at":"2026-08-16T16:47:07.313Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fca45e27bffe04165a956ecc37d1abcd","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.324Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-93e236fa9d4d0836f43b1ed3: start","job_status":"start","queue_duration_s":1.684018,"scheduling_latency_s":1.684035}1531gitlab # [ 272.115382] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:09.310Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"93e236fa9d4d0836f43b1ed3","created_at":"2026-08-16T16:47:07.313Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fca45e27bffe04165a956ecc37d1abcd","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.324Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-93e236fa9d4d0836f43b1ed3: done: 0.30272 sec","job_status":"done","queue_duration_s":1.684018,"scheduling_latency_s":1.684035,"redis_calls":562,"redis_duration_s":0.054665000000000005,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000682,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.053983,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.281327,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.30272,"completed_at":"2026-08-16T16:47:09.310Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1532gitlab # [ 272.155911] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:09.312Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"7d68e843e5d01a8c896db54c","created_at":"2026-08-16T16:47:07.334Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"741a9916caa0dc6e11f631ba7b1721cf","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.342Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-7d68e843e5d01a8c896db54c: start","job_status":"start","queue_duration_s":1.969858,"scheduling_latency_s":1.969881}1533gitlab # [ 272.170133] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:09.567Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"7d68e843e5d01a8c896db54c","created_at":"2026-08-16T16:47:07.334Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"741a9916caa0dc6e11f631ba7b1721cf","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.342Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-7d68e843e5d01a8c896db54c: done: 0.25555 sec","job_status":"done","queue_duration_s":1.969858,"scheduling_latency_s":1.969881,"redis_calls":9,"redis_duration_s":0.0014190000000000001,"redis_read_bytes":7,"redis_write_bytes":987,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000766,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000653,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":129,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":129,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.047,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.047,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.192758,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00046168,"exclusive_lock_hold_duration_s":0.24022552,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.25555,"completed_at":"2026-08-16T16:47:09.567Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.072374,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1534gitlab # [ 272.212178] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:09.568Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"3f1eb947d9266db979082ba0","created_at":"2026-08-16T16:47:07.356Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e79e00257ed3e87a67e53013c74048c1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.364Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-3f1eb947d9266db979082ba0: start","job_status":"start","queue_duration_s":2.204474,"scheduling_latency_s":2.204494}1535gitlab # [ 272.226688] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:09.581Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"3f1eb947d9266db979082ba0","created_at":"2026-08-16T16:47:07.356Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e79e00257ed3e87a67e53013c74048c1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-16T16:47:07.364Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-3f1eb947d9266db979082ba0: done: 0.012603 sec","job_status":"done","queue_duration_s":2.204474,"scheduling_latency_s":2.204494,"redis_calls":7,"redis_duration_s":0.0009260000000000001,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000671,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000255,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008124,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012603,"completed_at":"2026-08-16T16:47:09.581Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1536gitlab # [ 272.267577] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:09.582Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"f1724cfd51bb20a44dda6d90","created_at":"2026-08-16T16:47:07.370Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"948f0d40588e5b59e2aaf93404aeafaa","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-16T16:47:07.375Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-f1724cfd51bb20a44dda6d90: start","job_status":"start","queue_duration_s":2.206966,"scheduling_latency_s":2.206984}1537gitlab # [ 272.281596] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:09.589Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1538gitlab # [ 272.285005] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:09.595Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"f1724cfd51bb20a44dda6d90","created_at":"2026-08-16T16:47:07.370Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-343ff79981f548f1","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"948f0d40588e5b59e2aaf93404aeafaa","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-16T16:47:07.375Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-f1724cfd51bb20a44dda6d90: done: 0.012717 sec","job_status":"done","queue_duration_s":2.206966,"scheduling_latency_s":2.206984,"redis_calls":7,"redis_duration_s":0.000974,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000695,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000279,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008059,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012717,"completed_at":"2026-08-16T16:47:09.595Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1539gitlab # [ 272.325901] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:09.596Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e7ae82159082c0baa51b3f74","created_at":"2026-08-16T16:47:07.992Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-73b10f4e4b474cb9","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"454086d6c23c13a4da427b47acabc3de","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:08.004Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e7ae82159082c0baa51b3f74: start","job_status":"start","queue_duration_s":1.591831,"scheduling_latency_s":1.59185}1540gitlab # [ 272.338451] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:09.607Z","message":"No existing merge request to be cleaned up."}1541gitlab # [ 272.340092] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:09.616Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e7ae82159082c0baa51b3f74","created_at":"2026-08-16T16:47:07.992Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-73b10f4e4b474cb9","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"454086d6c23c13a4da427b47acabc3de","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:08.004Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e7ae82159082c0baa51b3f74: done: 0.019762 sec","job_status":"done","queue_duration_s":1.591831,"scheduling_latency_s":1.59185,"redis_calls":10,"redis_duration_s":0.0013249999999999998,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000765,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012971,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019762,"completed_at":"2026-08-16T16:47:09.616Z","load_balancing_strategy":"primary","db_duration_s":0.003339,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1542gitlab # [ 272.378942] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:09.617Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e3668b0cc9d790dfc969384c","created_at":"2026-08-16T16:47:07.992Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-73b10f4e4b474cb9","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"454086d6c23c13a4da427b47acabc3de","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:08.004Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e3668b0cc9d790dfc969384c: start","job_status":"start","queue_duration_s":1.612746,"scheduling_latency_s":1.612765}1543gitlab # [ 272.391626] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:09.633Z","message":"No existing merge request to be cleaned up."}1544gitlab # [ 272.393420] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:09.641Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e3668b0cc9d790dfc969384c","created_at":"2026-08-16T16:47:07.992Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-73b10f4e4b474cb9","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"454086d6c23c13a4da427b47acabc3de","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:08.004Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e3668b0cc9d790dfc969384c: done: 0.023933 sec","job_status":"done","queue_duration_s":1.612746,"scheduling_latency_s":1.612765,"redis_calls":10,"redis_duration_s":0.0013059999999999999,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000554,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000752,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01261,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023933,"completed_at":"2026-08-16T16:47:09.641Z","load_balancing_strategy":"primary","db_duration_s":0.008419,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1545gitlab # [ 272.432133] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:09.642Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0c566792703635c93d286983","created_at":"2026-08-16T16:47:07.992Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-73b10f4e4b474cb9","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"454086d6c23c13a4da427b47acabc3de","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:08.004Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0c566792703635c93d286983: start","job_status":"start","queue_duration_s":1.637803,"scheduling_latency_s":1.637821}1546gitlab # [ 272.444433] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:09.653Z","message":"No existing merge request to be cleaned up."}1547gitlab # [ 272.446118] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:09.661Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0c566792703635c93d286983","created_at":"2026-08-16T16:47:07.992Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-73b10f4e4b474cb9","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"454086d6c23c13a4da427b47acabc3de","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:08.004Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0c566792703635c93d286983: done: 0.018923 sec","job_status":"done","queue_duration_s":1.637803,"scheduling_latency_s":1.637821,"redis_calls":10,"redis_duration_s":0.001611,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000794,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000817,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012841,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018923,"completed_at":"2026-08-16T16:47:09.661Z","load_balancing_strategy":"primary","db_duration_s":0.002614,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1548gitlab # [ 272.485046] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:09.662Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"bd1ec89eec2da760ec641497","created_at":"2026-08-16T16:47:07.992Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-73b10f4e4b474cb9","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"454086d6c23c13a4da427b47acabc3de","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:08.004Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-bd1ec89eec2da760ec641497: start","job_status":"start","queue_duration_s":1.65785,"scheduling_latency_s":1.657867}1549gitlab # [ 272.497205] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:09.672Z","message":"No existing merge request to be cleaned up."}1550gitlab # [ 272.498921] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:09.680Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"bd1ec89eec2da760ec641497","created_at":"2026-08-16T16:47:07.992Z","trace_propagation_headers":{"sentry-trace":"96e7425d7c324c63a895d43f6c92c8e1-73b10f4e4b474cb9","baggage":"sentry-trace_id=96e7425d7c324c63a895d43f6c92c8e1,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"454086d6c23c13a4da427b47acabc3de","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:47:08.004Z","job_size_bytes":2,"pid":2009,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-bd1ec89eec2da760ec641497: done: 0.018057 sec","job_status":"done","queue_duration_s":1.65785,"scheduling_latency_s":1.657867,"redis_calls":10,"redis_duration_s":0.001303,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000579,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000724,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012447,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018057,"completed_at":"2026-08-16T16:47:09.680Z","load_balancing_strategy":"primary","db_duration_s":0.002337,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1551gitlab # [ 308.563466] postgres[3252]: [3252] ERROR: relation "table_without_models" does not exist1552gitlab # [ 308.569671] postgres[3252]: [3252] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1553gitlab # [ 309.122224] redis[791]: 10 changes in 300 seconds. Saving...1554gitlab # [ 309.125548] redis[791]: Background saving started by pid 32751555gitlab # [ 309.132170] redis[3275]: BGSAVE done, 448 keys saved, 0 keys skipped, 116758 bytes written.1556gitlab # [ 309.137113] redis[3275]: DB saved on disk1557gitlab # [ 309.139335] redis[3275]: Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB1558gitlab # [ 309.223406] redis[791]: Background saving terminated with success1559gitlab # [ 310.979144] postgres[863]: [863] LOG: checkpoint starting: time1560gitlab # [ 312.163735] gitaly[915]: time="2026-08-16T16:47:51.047Z" level=info msg="burden monitor stats" pid=9151561gitlab # [ 314.222492] runuser[2920]: pam_unix(runuser:session): session closed for user gitlab1562gitlab # [ 314.223638] setup-gitlab-start[2894]: + systemctl restart gitlab-sidekiq.service1563gitlab # [ 314.263619] systemd[1]: Stopping gitlab-sidekiq.service...1564gitlab # [ 314.266982] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:53.148Z","message":"Shutting down"}1565gitlab # [ 314.268776] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:53.149Z","message":"Scheduler exiting..."}1566gitlab # [ 314.270528] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:53.150Z","message":"Terminating quiet threads for default capsule"}1567gitlab # [ 314.272648] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:53.150Z","message":"Scheduler exiting..."}1568gitlab # [ 314.767255] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:53.652Z","message":"Pausing to allow jobs to finish..."}1569gitlab # [ 316.271255] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:55.155Z","message":"Bye!"}1570gitlab # [ 316.313471] sidekiq-cluster[2009]: {"severity":"INFO","time":"2026-08-16T16:47:55.198Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":2009,"worker_id":"sidekiq_0","memwd_rss_bytes":923471872,"retry":0}1571gitlab # [ 317.436080] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1572gitlab # [ 317.436730] systemd[1]: Stopped gitlab-sidekiq.service.1573gitlab # [ 317.441618] systemd[1]: gitlab-sidekiq.service: Consumed 1min 46.054s CPU time over 3min 16.286s wall clock time, 935.4M memory peak, 4.5M read from disk.1574gitlab # [ 317.447760] systemd[1]: Started gitlab-sidekiq.service.1575gitlab # [ 317.451241] setup-gitlab-start[2894]: + mkdir -p /var/lib/secrets1576gitlab # [ 317.454236] setup-gitlab-start[2894]: + echo nixbot-test-token-of-20-chars1577gitlab # [ 317.457199] setup-gitlab-start[2894]: + chmod 644 /var/lib/secrets/gitlab-token1578gitlab # [ 317.460217] setup-gitlab-start[2894]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1579gitlab # [ 319.827316] gitaly[915]: time="2026-08-16T16:47:58.711Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M05QJ1YNCGP7GQBQ0PEGSFRX error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T16:48:08.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:47:58.710" pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1580gitlab # [ 319.858243] gitaly[915]: time="2026-08-16T16:47:58.711Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05QJ1YNCGP7GQBQ0PEGSFRX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T16:48:08.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:47:58.710" grpc.time_ms=0.742 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1581gitlab # [ 320.449279] gitaly[915]: time="2026-08-16T16:47:59.334Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M05QJ1YNCGP7GQBQ0PEGSFRX error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T16:48:09.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:47:59.334" pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1582gitlab # [ 320.481264] gitaly[915]: time="2026-08-16T16:47:59.335Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05QJ1YNCGP7GQBQ0PEGSFRX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T16:48:09.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:47:59.334" grpc.time_ms=0.655 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1583gitlab # [ 320.579569] gitaly[915]: time="2026-08-16T16:47:59.464Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05QJ1YNCGP7GQBQ0PEGSFRX diskcache=76c7deb9-459c-4f2d-98ae-de26bc4ba45e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-16T16:48:09.073" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:47:59.403" pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1584gitlab # [ 320.610681] gitaly[915]: time="2026-08-16T16:47:59.465Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=34 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1437 command.oublock=32 command.real_time_ms=37 command.spawn_token_fork_ms=4 command.system_time_ms=34 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QJ1YNCGP7GQBQ0PEGSFRX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-16T16:48:09.073" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:47:59.403" grpc.time_ms=61.426 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1585gitlab # [ 320.639342] gitaly[915]: time="2026-08-16T16:47:59.504Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M05QJ1YNCGP7GQBQ0PEGSFRX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T16:48:09.172" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:47:59.502" pid=915 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1586gitlab # [ 320.656029] gitaly[915]: time="2026-08-16T16:47:59.504Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05QJ1YNCGP7GQBQ0PEGSFRX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T16:48:09.172" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:47:59.502" grpc.time_ms=1.401 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1587gitlab # [ 320.671554] gitaly[915]: time="2026-08-16T16:47:59.525Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M05QJ1YNCGP7GQBQ0PEGSFRX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T16:48:09.182" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:47:59.513" grpc.time_ms=12.231 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1588gitlab # [ 320.835992] gitaly[915]: time="2026-08-16T16:47:59.720Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M05QJ1YNCGP7GQBQ0PEGSFRX error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T16:48:09.020" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:47:59.720" pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1589gitlab # [ 320.846773] gitaly[915]: time="2026-08-16T16:47:59.721Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05QJ1YNCGP7GQBQ0PEGSFRX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T16:48:09.020" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:47:59.720" grpc.time_ms=0.586 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1590gitlab # [ 320.889669] gitaly[915]: time="2026-08-16T16:47:59.775Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05QJ1YNCGP7GQBQ0PEGSFRX diskcache=1ffaa571-fca4-4e38-8e10-870cae543939 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-16T16:48:09.025" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:47:59.726" pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1591gitlab # [ 320.900914] gitaly[915]: time="2026-08-16T16:47:59.775Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=24 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1436 command.oublock=32 command.real_time_ms=28 command.spawn_token_fork_ms=3 command.system_time_ms=22 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M05QJ1YNCGP7GQBQ0PEGSFRX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-16T16:48:09.025" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:47:59.726" grpc.time_ms=49.101 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1592gitlab # [ 320.918192] gitaly[915]: time="2026-08-16T16:47:59.803Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M05QJ1YNCGP7GQBQ0PEGSFRX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T16:48:09.102" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:47:59.802" pid=915 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1593gitlab # [ 320.929647] gitaly[915]: time="2026-08-16T16:47:59.804Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05QJ1YNCGP7GQBQ0PEGSFRX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T16:48:09.102" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:47:59.802" grpc.time_ms=1.194 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1594gitlab # [ 320.943563] gitaly[915]: time="2026-08-16T16:47:59.829Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QJ1YNCGP7GQBQ0PEGSFRX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T16:48:09.112" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:47:59.813" grpc.time_ms=15.486 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1595gitlab # [ 321.041451] gitaly[915]: time="2026-08-16T16:47:59.926Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05QJ1YNCGP7GQBQ0PEGSFRX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T16:48:09.225" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:47:59.926" grpc.time_ms=0.392 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1596gitlab # [ 321.084755] gitaly[915]: time="2026-08-16T16:47:59.970Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05QJ1YNCGP7GQBQ0PEGSFRX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-16T16:48:09.264" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:47:59.965" grpc.time_ms=1.137 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1597gitlab # [ 322.757548] sidekiq-cluster[3313]: {"severity":"INFO","time":"2026-08-16T16:48:01.613Z","message":"Starting cluster with 1 processes"}1598gitlab # [ 322.790831] gitaly[915]: time="2026-08-16T16:48:01.675Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QJ1YNCGP7GQBQ0PEGSFRX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T16:48:11.005" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:48:01.665" grpc.time_ms=9.266 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1599gitlab # [ 323.374323] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:48:02 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 58851600gitlab # [ 323.378487] setup-gitlab-start[2894]: + mkdir -p /tmp/test-flake1601gitlab # [ 323.383810] setup-gitlab-start[2894]: + cd /tmp/test-flake1602gitlab # [ 323.384862] setup-gitlab-start[2894]: + git init -b master1603gitlab # [ 323.414329] setup-gitlab-start[3382]: Initialized empty Git repository in /tmp/test-flake/.git/1604gitlab # [ 323.415997] setup-gitlab-start[2894]: + git config user.name test1605gitlab # [ 323.422260] setup-gitlab-start[2894]: + git config user.email test@example.com1606gitlab # [ 323.429207] setup-gitlab-start[2894]: + cat1607gitlab # [ 323.434931] setup-gitlab-start[2894]: + git add flake.nix1608gitlab # [ 323.443515] setup-gitlab-start[2894]: + git commit -m 'initial commit'1609gitlab # [ 323.474521] setup-gitlab-start[3387]: [master (root-commit) 4d3fb0a] initial commit1610gitlab # [ 323.477920] setup-gitlab-start[3387]: 1 file changed, 10 insertions(+)1611gitlab # [ 323.480602] setup-gitlab-start[3387]: create mode 100644 flake.nix1612gitlab # [ 323.483169] setup-gitlab-start[2894]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1613gitlab # [ 323.488163] setup-gitlab-start[2894]: + git push -u origin master1614gitlab # [ 323.627976] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:48:02 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 881615gitlab # [ 323.886799] gitaly[915]: time="2026-08-16T16:48:02.771Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M05QJ7YKH77RAG1P9P1WZMRH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:48:02.749" grpc.time_ms=20.82 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1616gitlab # [ 323.920072] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:48:02 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 2561617gitlab # [ 324.342795] gitaly[915]: time="2026-08-16T16:48:03.228Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QJ87A61M882N27ZWSTC1E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T16:48:13.009" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:48:03.210" grpc.time_ms=17.451 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1618gitlab # [ 324.415638] gitaly[915]: time="2026-08-16T16:48:03.301Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QJ87A61M882N27ZWSTC1E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-16T16:48:33.081" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-16T16:48:03.282" grpc.time_ms=18.656 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1619gitlab # [ 324.455919] gitaly[915]: time="2026-08-16T16:48:03.341Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M05QJ87A61M882N27ZWSTC1E duration_ms=279ns method=POST pid=915 status=200 url="http://unix/api/v4/internal/allowed"1620gitlab # [ 324.507609] gitaly[915]: time="2026-08-16T16:48:03.393Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M05QJ87A61M882N27ZWSTC1E duration_ms=50ns method=POST pid=915 status=200 url="http://unix/api/v4/internal/pre_receive"1621gitlab # [ 324.516849] gitaly[915]: time="2026-08-16T16:48:03.393Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QJ87A61M882N27ZWSTC1E grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5315 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:48:03.059" grpc.time_ms=334.378 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1622gitlab # [ 324.559280] gitaly[915]: time="2026-08-16T16:48:03.444Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QJ87A61M882N27ZWSTC1E grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:48:03.443" grpc.time_ms=1.179 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1623gitlab # [ 324.603759] gitaly[915]: time="2026-08-16T16:48:03.489Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QJ87A61M882N27ZWSTC1E grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4784 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:48:03.488" grpc.time_ms=0.675 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1624gitlab # [ 324.656392] gitaly[915]: time="2026-08-16T16:48:03.541Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QJ87A61M882N27ZWSTC1E grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:48:03.540" grpc.time_ms=0.711 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1625gitlab # [ 325.080358] gitaly[915]: time="2026-08-16T16:48:03.964Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QJ87A61M882N27ZWSTC1E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T16:48:13.010" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:48:03.951" grpc.time_ms=13.17 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1626gitlab # [ 325.139406] gitaly[915]: time="2026-08-16T16:48:04.024Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1432 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=5 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M05QJ87A61M882N27ZWSTC1E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-16T16:48:13.059" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:48:04.000" grpc.time_ms=24.385 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1627gitlab # [ 325.193947] gitaly[915]: time="2026-08-16T16:48:04.079Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M05QJ87A61M882N27ZWSTC1E duration_ms=511ns method=POST pid=915 status=200 url="http://unix/api/v4/internal/post_receive"1628gitlab # [ 325.203286] gitaly[915]: time="2026-08-16T16:48:04.080Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QJ87A61M882N27ZWSTC1E grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4809 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:48:03.567" grpc.time_ms=513.214 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1629gitlab # [ 325.235313] gitaly[915]: time="2026-08-16T16:48:04.091Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M05QJ87A61M882N27ZWSTC1E diskcache=2bbaeb76-2c53-4adc-9ab9-f054e7a0b527 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:48:02.938" pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1630gitlab # [ 325.256996] systemd[1]: Finished setup-gitlab.service.1631gitlab # [ 325.258755] gitlab-workhorse[822]: time="2026-08-16T16:48:04Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521632gitlab # [ 325.261995] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:48:04 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 12971633gitlab # [ 325.265452] setup-gitlab-start[3391]: To http://gitlab/root/test-flake.git1634gitlab # [ 325.266891] setup-gitlab-start[3391]: * [new branch] master -> master1635gitlab # [ 325.268359] setup-gitlab-start[3391]: branch 'master' set up to track 'origin/master'.1636gitlab # [ 325.269929] gitaly[915]: time="2026-08-16T16:48:04.091Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=310 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=851968 command.minflt=13558 command.oublock=32 command.real_time_ms=1144 command.spawn_token_fork_ms=2 command.system_time_ms=186 command.user_time_ms=124 component=gitaly.StreamServerInterceptor correlation_id=01M05QJ87A61M882N27ZWSTC1E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=684 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:48:02.938" grpc.time_ms=1152.842 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1637gitlab # [ 325.288563] systemd[1]: Starting nixbot CI service...1638gitlab: (finished: waiting for unit setup-gitlab.service, in 325.91 seconds)1639gitlab: waiting for unit nixbot.service1640gitlab # [ 326.363449] nixbot[3479]: {"ts": "2026-08-16T16:48:05.247Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1641gitlab # [ 326.387956] nixbot[3479]: {"ts": "2026-08-16T16:48:05.273Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1642gitlab # [ 326.404994] nixbot[3479]: {"ts": "2026-08-16T16:48:05.290Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1643gitlab # [ 326.411692] nixbot[3479]: {"ts": "2026-08-16T16:48:05.295Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1644gitlab # [ 326.418744] nixbot[3479]: {"ts": "2026-08-16T16:48:05.299Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1645gitlab # [ 326.425265] nixbot[3479]: {"ts": "2026-08-16T16:48:05.305Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1646gitlab # [ 326.431748] nixbot[3479]: {"ts": "2026-08-16T16:48:05.309Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1647gitlab # [ 326.439241] nixbot[3479]: {"ts": "2026-08-16T16:48:05.312Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1648gitlab # [ 326.445869] nixbot[3479]: {"ts": "2026-08-16T16:48:05.323Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1649gitlab # [ 326.452487] nixbot[3479]: {"ts": "2026-08-16T16:48:05.326Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1650gitlab # [ 326.459170] nixbot[3479]: {"ts": "2026-08-16T16:48:05.332Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1651gitlab # [ 326.465659] nixbot[3479]: {"ts": "2026-08-16T16:48:05.338Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1652gitlab # [ 326.472428] nixbot[3479]: {"ts": "2026-08-16T16:48:05.341Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1653gitlab # [ 326.479043] nixbot[3479]: {"ts": "2026-08-16T16:48:05.345Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1654gitlab # [ 326.485549] nixbot[3479]: {"ts": "2026-08-16T16:48:05.351Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1655gitlab # [ 326.491370] nixbot[3479]: {"ts": "2026-08-16T16:48:05.353Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1656gitlab # [ 326.497151] nixbot[3479]: {"ts": "2026-08-16T16:48:05.355Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1657gitlab # [ 326.502723] nixbot[3479]: {"ts": "2026-08-16T16:48:05.357Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1658gitlab # [ 326.507805] nixbot[3479]: {"ts": "2026-08-16T16:48:05.365Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1659gitlab # [ 326.512977] nixbot[3479]: {"ts": "2026-08-16T16:48:05.367Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1660gitlab # [ 326.517397] nixbot[3479]: {"ts": "2026-08-16T16:48:05.369Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1661gitlab # [ 326.521328] nixbot[3479]: {"ts": "2026-08-16T16:48:05.375Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1662gitlab # [ 326.525205] nixbot[3479]: {"ts": "2026-08-16T16:48:05.377Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1663gitlab # [ 326.530847] nixbot[3479]: {"ts": "2026-08-16T16:48:05.380Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1664gitlab # [ 326.539679] nixbot[3479]: {"ts": "2026-08-16T16:48:05.381Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1665gitlab # [ 326.944506] nixbot[3479]: INFO: Started server process [3479]1666gitlab # [ 326.947230] nixbot[3479]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1667gitlab # [ 326.963973] nixbot[3479]: INFO: ::ffff:127.0.0.1:52454 - "GET /health HTTP/1.1" 200 OK1668gitlab # [ 326.973166] systemd[1]: Started nixbot CI service.1669gitlab # [ 326.975690] systemd[1]: Reached target Multi-User System.1670gitlab # [ 326.978410] systemd[1]: Startup finished in 707ms (kernel) + 4.380s (initrd) + 5min 21.890s (userspace) = 5min 26.978s.1671gitlab: (finished: waiting for unit nixbot.service, in 2.13 seconds)1672gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1673gitlab # [ 327.667122] nixbot[3479]: INFO: ::ffff:127.0.0.1:52462 - "GET /health HTTP/1.1" 200 OK1674gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.06 seconds)1675subtest: project discovered and webhook registered1676gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1677gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.16 seconds)1678gitlab # [ 327.833440] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:48:06 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 1051679gitlab # [ 328.390641] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:48:07 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 14241680gitlab # [ 328.398358] nixbot[3479]: {"ts": "2026-08-16T16:48:07.277Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1681gitlab # [ 328.431434] nixbot[3479]: {"ts": "2026-08-16T16:48:07.316Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1682gitlab # [ 328.511651] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:48:07 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 711683gitlab # [ 328.514323] nixbot[3479]: {"ts": "2026-08-16T16:48:07.399Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1684gitlab # [ 328.517922] nixbot[3479]: {"ts": "2026-08-16T16:48:07.403Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1685gitlab # [ 328.682401] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:48:07 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 1591686gitlab # [ 328.690060] nixbot[3479]: {"ts": "2026-08-16T16:48:07.569Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1687gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1688gitlab # [ 328.929249] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:48:07 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 2311689gitlab # [ 328.932524] nixbot[3479]: {"ts": "2026-08-16T16:48:07.816Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1690gitlab # [ 329.042242] nixbot[3479]: {"ts": "2026-08-16T16:48:07.927Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1691gitlab # [ 329.045598] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:48:07 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 911692gitlab # [ 329.048552] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:48:07 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 1621693gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.21 seconds)1694(finished: subtest: project discovered and webhook registered, in 1.38 seconds)1695subtest: push delivers the webhook1696gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1697gitlab # [ 329.132304] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:48:08 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 791698gitlab # [ 329.134468] nixbot[3479]: {"ts": "2026-08-16T16:48:08.018Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1699gitlab # [ 329.188342] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:48:08 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 611700gitlab # [ 329.226341] gitaly[915]: time="2026-08-16T16:48:08.109Z" level=info msg="finished unary call with code OK" catfile.duration_ms=5 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=5 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QJDAYEFRPMNJSY1PW3XAW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-08-16T16:48:38.083" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:48:08.084" grpc.time_ms=23.909 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1701gitlab # [ 329.262544] gitaly[915]: time="2026-08-16T16:48:08.148Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QJDAYEFRPMNJSY1PW3XAW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:48:38.145" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:48:08.147" grpc.time_ms=0.862 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1702gitlab # [ 329.285656] gitaly[915]: time="2026-08-16T16:48:08.171Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=6 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05QJDAYEFRPMNJSY1PW3XAW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-16T16:48:18.005" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:48:08.156" grpc.time_ms=13.858 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1703gitlab # [ 329.306945] gitaly[915]: time="2026-08-16T16:48:08.192Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M05QJDCBKANS8ME8DDMHKGQR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=246 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:48:08.184" grpc.time_ms=8.156 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1704gitlab # Enumerating objects: 5, done.1705gitlab # [ 329.322497] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:48:08 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 201 "" "git/2.55.0" 1171706gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1707gitlab # Delta compression using up to 4 threads1708gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1709gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 274 bytes | 274.00 KiB/s, done.1710gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1711gitlab # [ 329.355803] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:48:08 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 2101712gitlab # [ 329.360760] nixbot[3479]: {"ts": "2026-08-16T16:48:08.246Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1713gitlab # [ 329.497609] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:48:08 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1311714gitlab # [ 329.502022] nixbot[3479]: {"ts": "2026-08-16T16:48:08.384Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1715gitlab # [ 329.508159] nixbot[3479]: {"ts": "2026-08-16T16:48:08.388Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1716gitlab # [ 329.599071] gitaly[915]: time="2026-08-16T16:48:08.484Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=4 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QJDGY15739NMS0VRRZ16G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-16T16:48:38.066" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-16T16:48:08.467" grpc.time_ms=16.508 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1717gitlab # [ 329.629066] gitaly[915]: time="2026-08-16T16:48:08.510Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M05QJDGY15739NMS0VRRZ16G duration_ms=132ns method=POST pid=915 status=200 url="http://unix/api/v4/internal/allowed"1718gitlab # [ 329.643477] gitaly[915]: time="2026-08-16T16:48:08.528Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05QJDQGMTTC6MK3AW72SY1C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:48:08.514" grpc.time_ms=14.19 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1719gitlab # [ 329.661729] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:48:08 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1051720gitlab # [ 329.672073] gitaly[915]: time="2026-08-16T16:48:08.557Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M05QJDGY15739NMS0VRRZ16G duration_ms=46ns method=POST pid=915 status=200 url="http://unix/api/v4/internal/pre_receive"1721gitlab # [ 329.676184] gitaly[915]: time="2026-08-16T16:48:08.557Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QJDGY15739NMS0VRRZ16G grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5315 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:48:08.375" grpc.time_ms=181.835 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1722gitlab # [ 329.703403] gitaly[915]: time="2026-08-16T16:48:08.588Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QJDGY15739NMS0VRRZ16G grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:48:08.588" grpc.time_ms=0.558 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1723gitlab # [ 329.740048] gitaly[915]: time="2026-08-16T16:48:08.625Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QJDGY15739NMS0VRRZ16G grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4784 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:48:08.624" grpc.time_ms=0.52 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1724gitlab # [ 329.790026] gitaly[915]: time="2026-08-16T16:48:08.675Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05QJDTWFCTXC3QN29PK1Q1Q grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:48:08.665" pid=915 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1725gitlab # [ 329.804434] gitaly[915]: time="2026-08-16T16:48:08.675Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QJDTWFCTXC3QN29PK1Q1Q grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:48:08.665" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1726gitlab # [ 329.821040] gitlab-workhorse[822]: time="2026-08-16T16:48:08Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131727gitlab # [ 329.823276] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:48:08 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 1361728gitlab # [ 329.825724] gitaly[915]: time="2026-08-16T16:48:08.676Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QJDTWFCTXC3QN29PK1Q1Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:48:08.665" grpc.time_ms=10.799 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1729gitlab # [ 329.842694] gitaly[915]: time="2026-08-16T16:48:08.691Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QJDGY15739NMS0VRRZ16G grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:48:08.691" grpc.time_ms=0.589 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1730gitlab # [ 329.909197] gitaly[915]: time="2026-08-16T16:48:08.794Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05QJDZYAHXJPWAWA3Q3AKG1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:48:08.773" pid=915 remote_ip="2001:db8:1::1" request_sha=ddc4c84d9f265dc949a81d2ca562817e0b81de50 response_bytes=419 span.kind=server system=grpc1731gitlab # [ 329.930719] gitaly[915]: time="2026-08-16T16:48:08.794Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1134 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M05QJDZYAHXJPWAWA3Q3AKG1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:48:08.773" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1732gitlab # [ 329.952260] gitlab-workhorse[822]: time="2026-08-16T16:48:08Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=4191733gitlab # [ 329.954670] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:48:08 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 419 "" "git/2.55.0" 921734gitlab # [ 329.957447] gitaly[915]: time="2026-08-16T16:48:08.795Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1134 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M05QJDZYAHXJPWAWA3Q3AKG1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:48:08.773" grpc.time_ms=21.264 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1735gitlab # To http://gitlab/root/test-flake.git1736gitlab # [ 329.976120] gitaly[915]: time="2026-08-16T16:48:08.809Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M05QJDGY15739NMS0VRRZ16G duration_ms=81ns method=POST pid=915 status=200 url="http://unix/api/v4/internal/post_receive"1737gitlab # [ 329.980257] gitaly[915]: time="2026-08-16T16:48:08.810Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QJDGY15739NMS0VRRZ16G grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4809 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:48:08.727" grpc.time_ms=82.812 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1738gitlab # 4d3fb0a..82d436d [ 329.991799] gitaly[915]: time="2026-08-16T16:48:08.847Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M05QJDGY15739NMS0VRRZ16G diskcache=f96de680-849e-4b67-9e9d-81cc31d8ea3a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:48:08.292" pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1739gitlab # master -> master[ 330.002744] gitlab-workhorse[822]: time="2026-08-16T16:48:08Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521740gitlab # 1741gitlab # [ 330.004980] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:48:08 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 6261742gitlab # [ 330.007064] gitaly[915]: time="2026-08-16T16:48:08.847Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=207 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=851968 command.minflt=13059 command.oublock=32 command.real_time_ms=548 command.spawn_token_fork_ms=0 command.system_time_ms=128 command.user_time_ms=79 component=gitaly.StreamServerInterceptor correlation_id=01M05QJDGY15739NMS0VRRZ16G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=606 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=58 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:48:08.292" grpc.time_ms=554.66 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1743gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.98 seconds)1744gitlab: must succeed: git -C /tmp/test-flake rev-parse master1745gitlab # [ 330.020873] gitaly[915]: time="2026-08-16T16:48:08.906Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M05QJE438985S7ZF1S18F3NC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:48:08.896" grpc.time_ms=9.767 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1746gitlab # [ 330.033355] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:48:08 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 711747gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.02 seconds)1748gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1749gitlab # [ 330.088326] gitaly[915]: time="2026-08-16T16:48:08.973Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05QJE6CM77SJ342KHZH999F grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:48:08.963" pid=915 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1750gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.08 seconds)1751gitlab # [ 330.110734] gitaly[915]: time="2026-08-16T16:48:08.977Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M05QJE6CM77SJ342KHZH999F grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:48:08.963" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1752gitlab # [ 330.132305] gitlab-workhorse[822]: time="2026-08-16T16:48:08Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671753gitlab # [ 330.135889] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:48:08 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 701754gitlab # [ 330.139903] nixbot[3479]: INFO: ::ffff:127.0.0.1:52478 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1755gitlab # [ 330.143636] gitaly[915]: time="2026-08-16T16:48:08.978Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M05QJE6CM77SJ342KHZH999F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:48:08.963" grpc.time_ms=14.886 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1756gitlab # [ 330.210101] gitaly[915]: time="2026-08-16T16:48:09.095Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01M05QJEA4QAAQ6H870BQCSC86 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:48:09.082" grpc.time_ms=13.1 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1757gitlab # [ 330.238374] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:48:09 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 661758gitlab # [ 330.311066] gitaly[915]: time="2026-08-16T16:48:09.196Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05QJEC9W03DHQQQZQ7NJZMC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:48:09.164" pid=915 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1759gitlab # [ 330.324270] gitaly[915]: time="2026-08-16T16:48:09.196Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=26 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1102 command.oublock=0 command.real_time_ms=28 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=14 component=gitaly.UnaryServerInterceptor correlation_id=01M05QJEC9W03DHQQQZQ7NJZMC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:48:09.164" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1760gitlab # [ 330.342373] gitlab-workhorse[822]: time="2026-08-16T16:48:09Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091761gitlab # [ 330.344740] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:48:09 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 1001762gitlab # [ 330.348166] gitaly[915]: time="2026-08-16T16:48:09.197Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=26 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1102 command.oublock=0 command.real_time_ms=28 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=14 component=gitaly.UnaryServerInterceptor correlation_id=01M05QJEC9W03DHQQQZQ7NJZMC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:48:09.164" grpc.time_ms=32.885 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1763gitlab # [ 330.440083] gitaly[915]: time="2026-08-16T16:48:09.324Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QJEHE5J2KSZMP6F36R8T8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:48:39.322" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:48:09.323" grpc.time_ms=1.228 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1764gitlab # [ 330.497052] gitaly[915]: time="2026-08-16T16:48:09.382Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=592 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QJEHE5J2KSZMP6F36R8T8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-16T16:48:39.364" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:48:09.364" grpc.time_ms=18.007 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1765gitlab # [ 330.571601] gitaly[915]: time="2026-08-16T16:48:09.457Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QJEHE5J2KSZMP6F36R8T8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T16:48:19.290" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:48:09.440" grpc.time_ms=16.179 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1766gitlab # [ 330.608544] gitaly[915]: time="2026-08-16T16:48:09.493Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M05QJEHE5J2KSZMP6F36R8T8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T16:48:19.276" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:48:09.476" grpc.time_ms=17.173 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1767gitlab # [ 330.890325] gitaly[915]: time="2026-08-16T16:48:09.775Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05QJEHE5J2KSZMP6F36R8T8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-16T16:48:19.113" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:48:09.774" grpc.time_ms=0.721 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1768gitlab # [ 330.940708] gitaly[915]: time="2026-08-16T16:48:09.826Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M05QJEHE5J2KSZMP6F36R8T8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-16T16:48:19.151" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:48:09.812" grpc.time_ms=13.238 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1769gitlab # [ 331.017213] gitaly[915]: time="2026-08-16T16:48:09.902Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QJEHE5J2KSZMP6F36R8T8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4153 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:48:09.901" grpc.time_ms=0.895 pid=915 span.kind=server system=grpc1770gitlab # [ 331.069787] gitaly[915]: time="2026-08-16T16:48:09.955Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QJEHE5J2KSZMP6F36R8T8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:48:09.953" grpc.time_ms=0.936 pid=915 span.kind=server system=grpc1771gitlab # [ 331.099502] gitaly[915]: time="2026-08-16T16:48:09.967Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05QJEHE5J2KSZMP6F36R8T8 diskcache=70c66238-aa79-4826-bbca-eeb295f0016a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T16:48:19.170" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:48:09.830" pid=915 ref=refs/keep-around/4d3fb0aba4d1486190be170ec06ddc76cff21d6f remote_ip="2001:db8:1::1" revision=4d3fb0aba4d1486190be170ec06ddc76cff21d6f span.kind=server system=grpc username=root1772gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1773gitlab # [ 331.123196] gitaly[915]: time="2026-08-16T16:48:09.968Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=131 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5281 command.oublock=8 command.real_time_ms=129 command.spawn_token_fork_ms=2 command.system_time_ms=73 command.user_time_ms=58 component=gitaly.UnaryServerInterceptor correlation_id=01M05QJEHE5J2KSZMP6F36R8T8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T16:48:19.170" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:48:09.830" grpc.time_ms=136.977 pid=915 ref=refs/keep-around/4d3fb0aba4d1486190be170ec06ddc76cff21d6f remote_ip="2001:db8:1::1" revision=4d3fb0aba4d1486190be170ec06ddc76cff21d6f span.kind=server system=grpc username=root1774gitlab # [ 331.145278] gitaly[915]: time="2026-08-16T16:48:09.991Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QJEHE5J2KSZMP6F36R8T8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:48:39.789" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:48:09.990" grpc.time_ms=0.776 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1775gitlab # [ 331.186288] nixbot[3479]: INFO: ::ffff:127.0.0.1:36672 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1776gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.07 seconds)1777gitlab # [ 331.388923] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:48:10 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4d3fb0aba4d1486190be170ec06ddc76cff21d6f HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 10111778gitlab # [ 331.391849] nixbot[3479]: {"ts": "2026-08-16T16:48:10.275Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4d3fb0aba4d1486190be170ec06ddc76cff21d6f \"HTTP/1.1 201 Created\""}1779gitlab # [ 331.406161] nixbot[3479]: {"ts": "2026-08-16T16:48:10.291Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-4d3fb0aba4d1-0"}1780gitlab # [ 331.517082] systemd[1]: Started Nix Daemon.1781gitlab # [ 331.644693] nix-daemon[3693]: accepted connection from pid 3687, user nixbot1782gitlab # [ 331.784343] nix-daemon[3693]: accepted connection from pid 3700, user nixbot1783gitlab # [ 331.810154] nixbot[3479]: {"ts": "2026-08-16T16:48:10.695Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-4d3fb0aba4d1-0", "argv0": "bwrap"}1784gitlab # [ 332.024701] nix-daemon[3693]: accepted connection from pid 3710, user nixbot1785gitlab # [ 332.103620] nix-daemon[3693]: accepted connection from pid 3720, user nixbot1786gitlab # [ 332.123980] nix-daemon[3693]: accepted connection from pid 3710, user nixbot1787gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1788gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.06 seconds)1789gitlab # [ 332.247145] nixbot[3479]: INFO: ::ffff:127.0.0.1:36676 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1790gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1791gitlab # [ 333.300995] nixbot[3479]: INFO: ::ffff:127.0.0.1:36684 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1792gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.05 seconds)1793gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1794gitlab # [ 334.354615] nixbot[3479]: INFO: ::ffff:127.0.0.1:36692 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1795gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.05 seconds)1796gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1797gitlab # [ 335.409161] nixbot[3479]: INFO: ::ffff:127.0.0.1:36702 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1798gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.05 seconds)1799gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1800gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.05 seconds)1801gitlab # [ 336.462945] nixbot[3479]: INFO: ::ffff:127.0.0.1:36704 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1802gitlab # [ 336.776921] gitaly[915]: time="2026-08-16T16:48:15.661Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QJMNN62XCH17TYA9V770S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:48:45.259" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:48:15.659" grpc.time_ms=1.251 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1803gitlab # [ 337.029994] gitaly[915]: time="2026-08-16T16:48:15.915Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01M05QJMNN62XCH17TYA9V770S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T16:48:25.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:48:15.898" grpc.time_ms=16.579 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1804gitlab # [ 337.202807] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:48:16 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4d3fb0aba4d1486190be170ec06ddc76cff21d6f HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 5451805gitlab # [ 337.207061] nixbot[3479]: {"ts": "2026-08-16T16:48:16.090Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4d3fb0aba4d1486190be170ec06ddc76cff21d6f \"HTTP/1.1 201 Created\""}1806gitlab # [ 337.337338] gitaly[915]: time="2026-08-16T16:48:16.222Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QJN725SGQCR0EFRWKSER5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:48:46.220" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:48:16.221" grpc.time_ms=1.205 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1807gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1808gitlab # [ 337.515538] nixbot[3479]: INFO: ::ffff:127.0.0.1:36712 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1809gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.06 seconds)1810gitlab # [ 337.527310] gitaly[915]: time="2026-08-16T16:48:16.412Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QJN725SGQCR0EFRWKSER5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T16:48:26.246" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:48:16.397" grpc.time_ms=14.765 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1811gitlab # [ 337.634946] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:48:16 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4d3fb0aba4d1486190be170ec06ddc76cff21d6f HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 4211812gitlab # [ 337.643402] nixbot[3479]: {"ts": "2026-08-16T16:48:16.521Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4d3fb0aba4d1486190be170ec06ddc76cff21d6f \"HTTP/1.1 201 Created\""}1813gitlab # [ 337.920291] gitaly[915]: time="2026-08-16T16:48:16.805Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QJNMY1QBQJWJKY68JQGVW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:48:46.403" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:48:16.804" grpc.time_ms=0.925 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1814gitlab # [ 337.984194] gitaly[915]: time="2026-08-16T16:48:16.869Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05QJNMY1QBQJWJKY68JQGVW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T16:48:26.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:48:16.851" grpc.time_ms=17.41 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1815gitlab # [ 338.057378] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:48:16 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4d3fb0aba4d1486190be170ec06ddc76cff21d6f HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 3991816gitlab # [ 338.065414] nixbot[3479]: {"ts": "2026-08-16T16:48:16.944Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4d3fb0aba4d1486190be170ec06ddc76cff21d6f \"HTTP/1.1 201 Created\""}1817gitlab # [ 338.218367] nix-daemon[3693]: accepted connection from pid 3766, user nixbot1818gitlab # [ 338.418320] gitaly[915]: time="2026-08-16T16:48:17.303Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QJP8Z0JPJ3K7S8V1A4DH0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:48:17.286" grpc.time_ms=17.424 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1819gitlab # [ 338.446627] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:48:17 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1201820gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1821gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.06 seconds)1822gitlab # [ 338.561972] gitaly[915]: time="2026-08-16T16:48:17.447Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05QJPCVSMSSPF6RCJXM4KJH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:48:17.428" pid=915 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1823gitlab # [ 338.586779] gitaly[915]: time="2026-08-16T16:48:17.447Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QJPCVSMSSPF6RCJXM4KJH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:48:17.428" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1824gitlab # [ 338.623737] nixbot[3479]: INFO: ::ffff:127.0.0.1:36720 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1825gitlab # [ 338.627943] gitlab-workhorse[822]: time="2026-08-16T16:48:17Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671826gitlab # [ 338.631598] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:48:17 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1411827gitlab # [ 338.635099] gitaly[915]: time="2026-08-16T16:48:17.448Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QJPCVSMSSPF6RCJXM4KJH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:48:17.428" grpc.time_ms=19.67 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc1828gitlab # [ 338.738784] nix-daemon[3693]: accepted connection from pid 3794, user nixbot1829gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1830gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.05 seconds)1831gitlab # [ 339.636601] nixbot[3479]: INFO: ::ffff:127.0.0.1:36730 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1832gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1833gitlab # [ 340.688983] nixbot[3479]: INFO: ::ffff:127.0.0.1:36736 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1834gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.06 seconds)1835gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1836gitlab # [ 341.742671] nixbot[3479]: INFO: ::ffff:127.0.0.1:38710 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1837gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.05 seconds)1838gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1839gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.05 seconds)1840gitlab # [ 342.798783] nixbot[3479]: INFO: ::ffff:127.0.0.1:38716 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1841gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1842gitlab # [ 343.852752] nixbot[3479]: INFO: ::ffff:127.0.0.1:38718 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1843gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.06 seconds)1844gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1845gitlab # [ 344.908047] nixbot[3479]: INFO: ::ffff:127.0.0.1:38732 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1846gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.06 seconds)1847gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1848gitlab # [ 345.962596] nixbot[3479]: INFO: ::ffff:127.0.0.1:38740 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1849gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.05 seconds)1850gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1851gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.05 seconds)1852gitlab # [ 347.016531] nixbot[3479]: INFO: ::ffff:127.0.0.1:38754 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1853gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1854gitlab # [ 348.068342] nixbot[3479]: INFO: ::ffff:127.0.0.1:38758 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1855gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.05 seconds)1856gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1857gitlab # [ 349.122169] nixbot[3479]: INFO: ::ffff:127.0.0.1:38770 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1858gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.05 seconds)1859gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1860gitlab # [ 350.177504] nixbot[3479]: INFO: ::ffff:127.0.0.1:38776 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1861gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.06 seconds)1862gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1863gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.05 seconds)1864gitlab # [ 351.231540] nixbot[3479]: INFO: ::ffff:127.0.0.1:48850 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1865gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1866gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.05 seconds)1867gitlab # [ 352.282869] nixbot[3479]: INFO: ::ffff:127.0.0.1:48852 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1868gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1869gitlab # [ 353.334571] nixbot[3479]: INFO: ::ffff:127.0.0.1:48854 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1870gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.05 seconds)1871gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1872gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.05 seconds)1873gitlab # [ 354.389720] nixbot[3479]: INFO: ::ffff:127.0.0.1:48860 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1874gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1875gitlab # [ 355.442729] nixbot[3479]: INFO: ::ffff:127.0.0.1:48870 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1876gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.06 seconds)1877gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1878gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.05 seconds)1879gitlab # [ 356.497670] nixbot[3479]: INFO: ::ffff:127.0.0.1:48886 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1880gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1881gitlab # [ 357.550792] nixbot[3479]: INFO: ::ffff:127.0.0.1:48890 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1882gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.06 seconds)1883gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1884gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.05 seconds)1885gitlab # [ 358.606200] nixbot[3479]: INFO: ::ffff:127.0.0.1:48906 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1886gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1887gitlab # [ 359.660916] nixbot[3479]: INFO: ::ffff:127.0.0.1:48914 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1888gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.06 seconds)1889gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1890gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.05 seconds)1891gitlab # [ 360.716449] nixbot[3479]: INFO: ::ffff:127.0.0.1:48924 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1892gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1893gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.05 seconds)1894gitlab # [ 361.768979] nixbot[3479]: INFO: ::ffff:127.0.0.1:45038 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1895gitlab # [ 362.396464] sidekiq-cluster[3369]: 2026-08-16T16:48:41.280Z pid=3369 tid=yo1 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>3369, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>426024960}1896gitlab # [ 362.681407] sidekiq-cluster[3369]: W, [2026-08-16T16:48:41.566743 #3369] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1897gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1898gitlab # [ 362.816690] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:48:41.702Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1899gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.05 seconds)1900gitlab # [ 362.823163] nixbot[3479]: INFO: ::ffff:127.0.0.1:45044 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1901gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1902gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.05 seconds)1903gitlab # [ 363.874903] nixbot[3479]: INFO: ::ffff:127.0.0.1:45052 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1904gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1905gitlab # [ 364.926829] nixbot[3479]: INFO: ::ffff:127.0.0.1:45056 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1906gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.05 seconds)1907gitlab # [ 365.706052] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:48:44.590Z","message":"GitLab reliable fetch activated!"}1908gitlab # [ 365.706430] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:48:44.590Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1909gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1910gitlab # [ 365.983935] nixbot[3479]: INFO: ::ffff:127.0.0.1:45064 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1911gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.06 seconds)1912gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1913gitlab # [ 367.038015] nixbot[3479]: INFO: ::ffff:127.0.0.1:45070 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1914gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.05 seconds)1915gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1916gitlab # [ 368.095823] nixbot[3479]: INFO: ::ffff:127.0.0.1:45080 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1917gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.06 seconds)1918gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1919gitlab # [ 369.151622] nixbot[3479]: INFO: ::ffff:127.0.0.1:45088 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1920gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.05 seconds)1921gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1922gitlab # [ 370.208646] nixbot[3479]: INFO: ::ffff:127.0.0.1:45098 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1923gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.06 seconds)1924gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1925gitlab # [ 371.263080] nixbot[3479]: INFO: ::ffff:127.0.0.1:48778 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1926gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.06 seconds)1927gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1928gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.05 seconds)1929gitlab # [ 372.317594] nixbot[3479]: INFO: ::ffff:127.0.0.1:48794 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1930gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1931gitlab # [ 373.369894] nixbot[3479]: INFO: ::ffff:127.0.0.1:48800 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1932gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.05 seconds)1933gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1934gitlab # [ 374.423374] nixbot[3479]: INFO: ::ffff:127.0.0.1:48816 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1935gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.05 seconds)1936gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1937gitlab # [ 375.477417] nixbot[3479]: INFO: ::ffff:127.0.0.1:48828 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1938gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.05 seconds)1939gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1940gitlab # [ 376.530854] nixbot[3479]: INFO: ::ffff:127.0.0.1:48830 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1941gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.05 seconds)1942gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1943gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.05 seconds)1944gitlab # [ 377.584954] nixbot[3479]: INFO: ::ffff:127.0.0.1:48842 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1945gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1946gitlab # [ 378.636431] nixbot[3479]: INFO: ::ffff:127.0.0.1:48854 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1947gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.05 seconds)1948gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1949gitlab # [ 379.690579] nixbot[3479]: INFO: ::ffff:127.0.0.1:48868 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1950gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.05 seconds)1951gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1952gitlab # [ 380.744784] nixbot[3479]: INFO: ::ffff:127.0.0.1:48872 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1953gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.05 seconds)1954gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1955gitlab # [ 381.799063] nixbot[3479]: INFO: ::ffff:127.0.0.1:59614 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1956gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.05 seconds)1957gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1958gitlab # [ 382.853321] nixbot[3479]: INFO: ::ffff:127.0.0.1:59624 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1959gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.05 seconds)1960gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1961gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.05 seconds)1962gitlab # [ 383.907123] nixbot[3479]: INFO: ::ffff:127.0.0.1:59628 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1963gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1964gitlab # [ 384.958446] nixbot[3479]: INFO: ::ffff:127.0.0.1:59634 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1965gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.05 seconds)1966gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1967gitlab # [ 386.014056] nixbot[3479]: INFO: ::ffff:127.0.0.1:59648 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1968gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.06 seconds)1969gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1970gitlab # [ 387.068246] nixbot[3479]: INFO: ::ffff:127.0.0.1:59656 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1971gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.05 seconds)1972gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1973gitlab # [ 388.122992] nixbot[3479]: INFO: ::ffff:127.0.0.1:59658 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1974gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.05 seconds)1975gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1976gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.05 seconds)1977gitlab # [ 389.178482] nixbot[3479]: INFO: ::ffff:127.0.0.1:59666 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1978gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1979gitlab # [ 390.228846] nixbot[3479]: INFO: ::ffff:127.0.0.1:59668 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1980gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.05 seconds)1981gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1982gitlab # [ 391.281260] nixbot[3479]: INFO: ::ffff:127.0.0.1:46230 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1983gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.05 seconds)1984gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1985gitlab # [ 392.336210] nixbot[3479]: INFO: ::ffff:127.0.0.1:46242 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1986gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.06 seconds)1987gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1988gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.04 seconds)1989gitlab # [ 393.381443] nixbot[3479]: INFO: ::ffff:127.0.0.1:46258 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1990gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1991gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.05 seconds)1992gitlab # [ 394.434244] nixbot[3479]: INFO: ::ffff:127.0.0.1:46266 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1993gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1994gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.06 seconds)1995gitlab # [ 395.490423] nixbot[3479]: INFO: ::ffff:127.0.0.1:46268 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1996gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'1997gitlab # [ 396.519728] nixbot[3479]: INFO: ::ffff:127.0.0.1:46270 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK1998gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.03 seconds)1999gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'2000gitlab # [ 397.572118] nixbot[3479]: INFO: ::ffff:127.0.0.1:46280 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK2001gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.05 seconds)2002gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'2003gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.05 seconds)2004gitlab # [ 398.627624] nixbot[3479]: INFO: ::ffff:127.0.0.1:46290 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK2005gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'2006gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.06 seconds)2007gitlab # [ 399.684665] nixbot[3479]: INFO: ::ffff:127.0.0.1:46296 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK2008gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'2009gitlab # [ 400.738122] nixbot[3479]: INFO: ::ffff:127.0.0.1:46304 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK2010gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.06 seconds)2011gitlab # [ 401.579202] postgres[3994]: [3994] ERROR: relation "table_without_models" does not exist2012gitlab # [ 401.579581] postgres[3994]: [3994] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')2013gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'2014gitlab # [ 401.794764] nixbot[3479]: INFO: ::ffff:127.0.0.1:60504 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK2015gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.06 seconds)2016gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'2017gitlab # [ 402.852347] nixbot[3479]: INFO: ::ffff:127.0.0.1:60512 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK2018gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.06 seconds)2019gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'2020gitlab # [ 403.906761] nixbot[3479]: INFO: ::ffff:127.0.0.1:60526 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK2021gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.05 seconds)2022gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'2023gitlab # [ 404.961567] nixbot[3479]: INFO: ::ffff:127.0.0.1:60534 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK2024gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.06 seconds)2025gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'2026gitlab # [ 406.020667] nixbot[3479]: INFO: ::ffff:127.0.0.1:60536 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK2027gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.06 seconds)2028gitlab # [ 406.371960] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:25.256Z","message":"Booted Rails 7.2.3.1 application in production environment"}2029gitlab # [ 406.376918] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:25.262Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}2030gitlab # [ 406.378945] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:25.262Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}2031gitlab # [ 406.380782] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:25.262Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}2032gitlab # [ 406.382721] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:25.265Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2033gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'2034gitlab # [ 407.077348] nixbot[3479]: INFO: ::ffff:127.0.0.1:60540 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK2035gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.06 seconds)2036gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'2037gitlab # [ 408.132522] nixbot[3479]: INFO: ::ffff:127.0.0.1:60556 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK2038gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.06 seconds)2039gitlab # [ 409.089258] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:27.973Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"484303ec482812ce630d08bc","created_at":"2026-08-16T16:47:59.548Z","trace_propagation_headers":{"sentry-trace":"ac80878b2549432a9967096407e7e4c3-c74979435d324aad","baggage":"sentry-trace_id=ac80878b2549432a9967096407e7e4c3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QJ1YNCGP7GQBQ0PEGSFRX","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-16T16:47:59.620Z","job_size_bytes":2,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-484303ec482812ce630d08bc: start","job_status":"start","queue_duration_s":88.352691,"scheduling_latency_s":88.352744}2040gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'2041gitlab # [ 409.174733] nixbot[3479]: INFO: ::ffff:127.0.0.1:60566 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK2042gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.04 seconds)2043gitlab # [ 409.481585] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:28.366Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"484303ec482812ce630d08bc","created_at":"2026-08-16T16:47:59.548Z","trace_propagation_headers":{"sentry-trace":"ac80878b2549432a9967096407e7e4c3-c74979435d324aad","baggage":"sentry-trace_id=ac80878b2549432a9967096407e7e4c3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QJ1YNCGP7GQBQ0PEGSFRX","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-16T16:47:59.620Z","job_size_bytes":2,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-484303ec482812ce630d08bc: done: 0.392866 sec","job_status":"done","queue_duration_s":88.352691,"scheduling_latency_s":88.352744,"redis_calls":23,"redis_duration_s":0.010224,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.005548,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002697,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001979,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.199907,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.20389552,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.392866,"completed_at":"2026-08-16T16:49:28.365Z","load_balancing_strategy":"primary","db_duration_s":0.111491,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2044gitlab # [ 409.592865] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:28.369Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"6f97c3beea3a7bdff3520b1e","created_at":"2026-08-16T16:47:59.690Z","trace_propagation_headers":{"sentry-trace":"ac80878b2549432a9967096407e7e4c3-c74979435d324aad","baggage":"sentry-trace_id=ac80878b2549432a9967096407e7e4c3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QJ1YNCGP7GQBQ0PEGSFRX","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-16T16:47:59.707Z","job_size_bytes":2,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-6f97c3beea3a7bdff3520b1e: start","job_status":"start","queue_duration_s":88.661515,"scheduling_latency_s":88.661553}2045gitlab # [ 409.663768] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:28.548Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"6f97c3beea3a7bdff3520b1e","created_at":"2026-08-16T16:47:59.690Z","trace_propagation_headers":{"sentry-trace":"ac80878b2549432a9967096407e7e4c3-c74979435d324aad","baggage":"sentry-trace_id=ac80878b2549432a9967096407e7e4c3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QJ1YNCGP7GQBQ0PEGSFRX","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-16T16:47:59.707Z","job_size_bytes":2,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-6f97c3beea3a7bdff3520b1e: done: 0.179454 sec","job_status":"done","queue_duration_s":88.661515,"scheduling_latency_s":88.661553,"redis_calls":14,"redis_duration_s":0.0048519999999999995,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001083,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002175,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001594,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.132412,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.13813192,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.179454,"completed_at":"2026-08-16T16:49:28.548Z","load_balancing_strategy":"primary","db_duration_s":0.036514,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2046gitlab # [ 409.737136] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:28.551Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"c0720caafdd8deb2f35bc351","created_at":"2026-08-16T16:48:01.546Z","trace_propagation_headers":{"sentry-trace":"ac80878b2549432a9967096407e7e4c3-c74979435d324aad","baggage":"sentry-trace_id=ac80878b2549432a9967096407e7e4c3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QJ1YNCGP7GQBQ0PEGSFRX","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-16T16:48:01.553Z","job_size_bytes":5,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-c0720caafdd8deb2f35bc351: start","job_status":"start","queue_duration_s":86.998146,"scheduling_latency_s":86.998173}2047gitlab # [ 409.889919] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:28.774Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"c0720caafdd8deb2f35bc351","created_at":"2026-08-16T16:48:01.546Z","trace_propagation_headers":{"sentry-trace":"ac80878b2549432a9967096407e7e4c3-c74979435d324aad","baggage":"sentry-trace_id=ac80878b2549432a9967096407e7e4c3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QJ1YNCGP7GQBQ0PEGSFRX","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-16T16:48:01.553Z","job_size_bytes":5,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-c0720caafdd8deb2f35bc351: done: 0.223724 sec","job_status":"done","queue_duration_s":86.998146,"scheduling_latency_s":86.998173,"redis_calls":12,"redis_duration_s":0.003274,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000773,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001984,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000517,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.175812,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00039458,"duration_s":0.223724,"completed_at":"2026-08-16T16:49:28.774Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.040995,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2048gitlab # [ 409.996748] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:28.776Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"6f46531fd018d4330cf0073f","created_at":"2026-08-16T16:48:01.586Z","trace_propagation_headers":{"sentry-trace":"ac80878b2549432a9967096407e7e4c3-c74979435d324aad","baggage":"sentry-trace_id=ac80878b2549432a9967096407e7e4c3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QJ1YNCGP7GQBQ0PEGSFRX","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-16T16:48:01.592Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-6f46531fd018d4330cf0073f: start","job_status":"start","queue_duration_s":87.183672,"scheduling_latency_s":87.183691}2049gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'2050gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.06 seconds)2051gitlab # [ 410.182098] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:29.065Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"6f46531fd018d4330cf0073f","created_at":"2026-08-16T16:48:01.586Z","trace_propagation_headers":{"sentry-trace":"ac80878b2549432a9967096407e7e4c3-c74979435d324aad","baggage":"sentry-trace_id=ac80878b2549432a9967096407e7e4c3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QJ1YNCGP7GQBQ0PEGSFRX","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-16T16:48:01.592Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-6f46531fd018d4330cf0073f: done: 0.2891 sec","job_status":"done","queue_duration_s":87.183672,"scheduling_latency_s":87.183691,"redis_calls":11,"redis_duration_s":0.0038770000000000002,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00071,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002411,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000756,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.041,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.237,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.237,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.04,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.181874,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00097138,"duration_s":0.2891,"completed_at":"2026-08-16T16:49:29.065Z","load_balancing_strategy":"primary","db_duration_s":0.107473,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2052gitlab # [ 410.253899] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:29.069Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"0b8ad6856084534569e3e0f9","created_at":"2026-08-16T16:48:01.595Z","trace_propagation_headers":{"sentry-trace":"ac80878b2549432a9967096407e7e4c3-c74979435d324aad","baggage":"sentry-trace_id=ac80878b2549432a9967096407e7e4c3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QJ1YNCGP7GQBQ0PEGSFRX","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-16T16:48:01.600Z","job_size_bytes":89,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-0b8ad6856084534569e3e0f9: start","job_status":"start","queue_duration_s":87.468359,"scheduling_latency_s":87.4684}2053gitlab # [ 410.275997] nixbot[3479]: INFO: ::ffff:127.0.0.1:60580 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK2054gitlab # [ 410.278469] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:29.158Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"0b8ad6856084534569e3e0f9","created_at":"2026-08-16T16:48:01.595Z","trace_propagation_headers":{"sentry-trace":"ac80878b2549432a9967096407e7e4c3-c74979435d324aad","baggage":"sentry-trace_id=ac80878b2549432a9967096407e7e4c3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QJ1YNCGP7GQBQ0PEGSFRX","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-16T16:48:01.600Z","job_size_bytes":89,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-0b8ad6856084534569e3e0f9: done: 0.089221 sec","job_status":"done","queue_duration_s":87.468359,"scheduling_latency_s":87.4684,"redis_calls":11,"redis_duration_s":0.004879,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001291,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002438,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00115,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.06343,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00081034,"duration_s":0.089221,"completed_at":"2026-08-16T16:49:29.157Z","load_balancing_strategy":"primary","db_duration_s":0.010299,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2055gitlab # [ 410.326175] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:29.161Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 4d3fb0aba4d1486190be170ec06ddc76cff21d6f refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"11600dd717cdbd9b08ddfa9b","created_at":"2026-08-16T16:48:03.872Z","trace_propagation_headers":{"sentry-trace":"3dc808433774479eb4f6f74ece1a7147-0142396b877144da","baggage":"sentry-trace_id=3dc808433774479eb4f6f74ece1a7147,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QJ87A61M882N27ZWSTC1E","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:48:03.905Z","job_size_bytes":185,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-11600dd717cdbd9b08ddfa9b: start","job_status":"start","queue_duration_s":85.255659,"scheduling_latency_s":85.2557}2056gitlab # [ 410.343190] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:29.190Z","message":"changes: \"0000000000000000000000000000000000000000 4d3fb0aba4d1486190be170ec06ddc76cff21d6f refs/heads/master\\n\""}2057gitlab # [ 410.361285] gitaly[915]: time="2026-08-16T16:49:29.246Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QJ87A61M882N27ZWSTC1E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T16:49:39.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:49:29.233" grpc.time_ms=12.686 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2058gitlab # [ 410.380969] gitaly[915]: time="2026-08-16T16:49:29.266Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QJ87A61M882N27ZWSTC1E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T16:49:39.020" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:49:29.251" grpc.time_ms=14.835 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2059gitlab # [ 410.447570] gitaly[915]: time="2026-08-16T16:49:29.332Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QJ87A61M882N27ZWSTC1E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-16T16:49:39.089" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:49:29.319" grpc.time_ms=13.185 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2060gitlab # [ 410.513356] gitaly[915]: time="2026-08-16T16:49:29.398Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QJ87A61M882N27ZWSTC1E grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3936 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:49:29.398" grpc.time_ms=0.426 pid=915 span.kind=server system=grpc2061gitlab # [ 410.555884] gitaly[915]: time="2026-08-16T16:49:29.441Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QJ87A61M882N27ZWSTC1E grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3938 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:49:29.440" grpc.time_ms=0.509 pid=915 span.kind=server system=grpc2062gitlab # [ 410.581684] gitaly[915]: time="2026-08-16T16:49:29.453Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05QJ87A61M882N27ZWSTC1E diskcache=9d5831d1-a3f7-4357-82fa-6401a57562ca grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T16:49:39.113" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:49:29.343" pid=915 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2063gitlab # [ 410.602063] gitaly[915]: time="2026-08-16T16:49:29.453Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=122 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5138 command.oublock=8 command.real_time_ms=103 command.spawn_token_fork_ms=1 command.system_time_ms=59 command.user_time_ms=63 component=gitaly.UnaryServerInterceptor correlation_id=01M05QJ87A61M882N27ZWSTC1E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T16:49:39.113" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:49:29.343" grpc.time_ms=109.658 pid=915 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2064gitlab # [ 410.623015] gitaly[915]: time="2026-08-16T16:49:29.478Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05QJ87A61M882N27ZWSTC1E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T16:49:39.247" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:49:29.478" grpc.time_ms=0.299 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2065gitlab # [ 410.636760] gitaly[915]: time="2026-08-16T16:49:29.510Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=860 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=1 command.system_time_ms=15 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05QJ87A61M882N27ZWSTC1E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-16T16:49:39.256" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:49:29.486" grpc.time_ms=23.838 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2066gitlab # [ 410.794506] gitaly[915]: time="2026-08-16T16:49:29.679Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=313 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QJ87A61M882N27ZWSTC1E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-08-16T16:49:59.067" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:49:29.668" grpc.time_ms=11.563 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2067gitlab # [ 410.853247] gitaly[915]: time="2026-08-16T16:49:29.738Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05QJ87A61M882N27ZWSTC1E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-16T16:49:39.007" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:49:29.737" grpc.time_ms=0.522 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2068gitlab # [ 410.884104] gitaly[915]: time="2026-08-16T16:49:29.753Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=316 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QJ87A61M882N27ZWSTC1E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-16T16:49:39.012" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-08-16T16:49:29.742" grpc.time_ms=10.755 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2069gitlab # [ 410.910131] gitaly[915]: time="2026-08-16T16:49:29.795Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05QJ87A61M882N27ZWSTC1E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T16:49:39.048" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:49:29.778" grpc.time_ms=16.295 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2070gitlab # [ 410.935930] gitaly[915]: time="2026-08-16T16:49:29.821Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M05QJ87A61M882N27ZWSTC1E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T16:49:39.074" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:49:29.804" grpc.time_ms=16.387 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2071gitlab # [ 410.978734] gitaly[915]: time="2026-08-16T16:49:29.864Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=879 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=1 command.system_time_ms=20 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QJ87A61M882N27ZWSTC1E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-16T16:49:59.236" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:49:29.836" grpc.time_ms=27.111 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2072gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'2073gitlab # [ 411.304573] nixbot[3479]: INFO: ::ffff:127.0.0.1:38480 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK2074gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.07 seconds)2075gitlab # [ 411.593896] gitaly[915]: time="2026-08-16T16:49:30.478Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QJ87A61M882N27ZWSTC1E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-16T16:49:40.245" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:49:30.476" grpc.time_ms=1.848 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2076gitlab # [ 411.631951] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:30.512Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 4d3fb0aba4d1486190be170ec06ddc76cff21d6f refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"11600dd717cdbd9b08ddfa9b","created_at":"2026-08-16T16:48:03.872Z","trace_propagation_headers":{"sentry-trace":"3dc808433774479eb4f6f74ece1a7147-0142396b877144da","baggage":"sentry-trace_id=3dc808433774479eb4f6f74ece1a7147,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QJ87A61M882N27ZWSTC1E","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:48:03.905Z","job_size_bytes":185,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-11600dd717cdbd9b08ddfa9b: done: 1.351128 sec","job_status":"done","queue_duration_s":85.255659,"scheduling_latency_s":85.2557,"gitaly_calls":13,"gitaly_duration_s":0.31003,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.05831,"redis_read_bytes":2103,"redis_write_bytes":21747,"redis_cache_calls":15,"redis_cache_duration_s":0.005435,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.009044,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.002403,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7835,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.00575,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.022069,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.013609,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.085,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.31,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.357,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.085,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.899025,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0009559,"exclusive_lock_hold_duration_s":0.0381845,"duration_s":1.351128,"completed_at":"2026-08-16T16:49:30.512Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.151015,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2077gitlab # [ 411.721924] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:30.514Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","4d3fb0aba4d1486190be170ec06ddc76cff21d6f 82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"49f6558ace942036de0b7c7f","created_at":"2026-08-16T16:48:08.780Z","trace_propagation_headers":{"sentry-trace":"d63357342b9d43fe9f686ac1be98fc6d-b8b6ba2ed48b4597","baggage":"sentry-trace_id=d63357342b9d43fe9f686ac1be98fc6d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QJDGY15739NMS0VRRZ16G","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:48:08.785Z","job_size_bytes":185,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-49f6558ace942036de0b7c7f: start","job_status":"start","queue_duration_s":81.728546,"scheduling_latency_s":81.728567}2078gitlab # [ 411.740648] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:30.526Z","message":"changes: \"4d3fb0aba4d1486190be170ec06ddc76cff21d6f 82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 refs/heads/master\\n\""}2079gitlab # [ 411.743050] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:30.586Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"6aa7a3014e7582ae4b9d8894","created_at":"2026-08-16T16:49:30.582Z","trace_propagation_headers":{"sentry-trace":"d63357342b9d43fe9f686ac1be98fc6d-444299465d094821","baggage":"sentry-trace_id=d63357342b9d43fe9f686ac1be98fc6d,sentry-release=Unknown"},"correlation_id":"01M05QJDGY15739NMS0VRRZ16G","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"0c691f6333d8833ad1a3af6d","job_size_bytes":46,"pid":3369,"job_status":"deduplicated","message":"ProjectCacheWorker JID-6aa7a3014e7582ae4b9d8894: deduplicated: until executing","deduplication.type":"until executing"}2080gitlab # [ 411.758364] gitaly[915]: time="2026-08-16T16:49:30.562Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M05QJDGY15739NMS0VRRZ16G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T16:49:40.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:49:30.545" grpc.time_ms=16.873 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2081gitlab # [ 411.771873] gitaly[915]: time="2026-08-16T16:49:30.578Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QJDGY15739NMS0VRRZ16G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T16:49:40.030" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:49:30.570" grpc.time_ms=7.915 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2082gitlab # [ 411.786688] gitaly[915]: time="2026-08-16T16:49:30.624Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01M05QJDGY15739NMS0VRRZ16G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-16T16:49:40.071" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:49:30.612" grpc.time_ms=11.936 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2083gitlab # [ 411.800347] gitaly[915]: time="2026-08-16T16:49:30.651Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=595 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QJDGY15739NMS0VRRZ16G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-08-16T16:50:00.032" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:49:30.632" grpc.time_ms=18.154 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2084gitlab # [ 411.815907] gitaly[915]: time="2026-08-16T16:49:30.682Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=318 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QJDGY15739NMS0VRRZ16G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-16T16:49:40.130" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-08-16T16:49:30.671" grpc.time_ms=11.068 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2085gitlab # [ 411.830986] gitaly[915]: time="2026-08-16T16:49:30.716Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QJDGY15739NMS0VRRZ16G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T16:49:40.159" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:49:30.700" grpc.time_ms=16.188 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2086gitlab # [ 412.006273] gitaly[915]: time="2026-08-16T16:49:30.891Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QJDGY15739NMS0VRRZ16G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-16T16:49:40.155" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:49:30.885" grpc.time_ms=6.011 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2087gitlab # [ 412.054731] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:30.938Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","4d3fb0aba4d1486190be170ec06ddc76cff21d6f 82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"49f6558ace942036de0b7c7f","created_at":"2026-08-16T16:48:08.780Z","trace_propagation_headers":{"sentry-trace":"d63357342b9d43fe9f686ac1be98fc6d-b8b6ba2ed48b4597","baggage":"sentry-trace_id=d63357342b9d43fe9f686ac1be98fc6d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QJDGY15739NMS0VRRZ16G","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T16:48:08.785Z","job_size_bytes":185,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-49f6558ace942036de0b7c7f: done: 0.424603 sec","job_status":"done","queue_duration_s":81.728546,"scheduling_latency_s":81.728567,"gitaly_calls":7,"gitaly_duration_s":0.116215,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.032819,"redis_read_bytes":500,"redis_write_bytes":11944,"redis_cache_calls":9,"redis_cache_duration_s":0.003747,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001509,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5721,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.005139,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.010035,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.012389,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.039,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.038,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.038,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.039,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.270398,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00072904,"exclusive_lock_hold_duration_s":0.02784754,"duration_s":0.424603,"completed_at":"2026-08-16T16:49:30.938Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.04002,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2088gitlab # [ 412.139009] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:30.942Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"e8e219605adf7cf358bdedd6","created_at":"2026-08-16T16:48:10.001Z","trace_propagation_headers":{"sentry-trace":"f289add8f8bf49dca6216e1942af5bf1-5c0b411b545640e9","baggage":"sentry-trace_id=f289add8f8bf49dca6216e1942af5bf1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QJEHE5J2KSZMP6F36R8T8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-16T16:48:10.014Z","job_size_bytes":65,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-e8e219605adf7cf358bdedd6: start","job_status":"start","queue_duration_s":80.92821,"scheduling_latency_s":80.928257}2089gitlab # [ 412.223423] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:31.108Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"e8e219605adf7cf358bdedd6","created_at":"2026-08-16T16:48:10.001Z","trace_propagation_headers":{"sentry-trace":"f289add8f8bf49dca6216e1942af5bf1-5c0b411b545640e9","baggage":"sentry-trace_id=f289add8f8bf49dca6216e1942af5bf1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QJEHE5J2KSZMP6F36R8T8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-16T16:48:10.014Z","job_size_bytes":65,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-e8e219605adf7cf358bdedd6: done: 0.16549 sec","job_status":"done","queue_duration_s":80.92821,"scheduling_latency_s":80.928257,"redis_calls":16,"redis_duration_s":0.006847,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.003509,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002461,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000877,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.114092,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00077398,"duration_s":0.16549,"completed_at":"2026-08-16T16:49:31.108Z","load_balancing_strategy":"primary","db_duration_s":0.037172,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2090gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'2091gitlab # [ 412.309272] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:31.110Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"b876ef321839bf0878c23237","created_at":"2026-08-16T16:48:10.016Z","trace_propagation_headers":{"sentry-trace":"f289add8f8bf49dca6216e1942af5bf1-5c0b411b545640e9","baggage":"sentry-trace_id=f289add8f8bf49dca6216e1942af5bf1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QJEHE5J2KSZMP6F36R8T8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-16T16:48:10.035Z","job_size_bytes":65,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-b876ef321839bf0878c23237: start","job_status":"start","queue_duration_s":81.075066,"scheduling_latency_s":81.075098}2092gitlab # [ 412.370226] nixbot[3479]: INFO: ::ffff:127.0.0.1:38496 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK2093gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.07 seconds)2094gitlab # [ 412.553190] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:31.437Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"b876ef321839bf0878c23237","created_at":"2026-08-16T16:48:10.016Z","trace_propagation_headers":{"sentry-trace":"f289add8f8bf49dca6216e1942af5bf1-5c0b411b545640e9","baggage":"sentry-trace_id=f289add8f8bf49dca6216e1942af5bf1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QJEHE5J2KSZMP6F36R8T8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-16T16:48:10.035Z","job_size_bytes":65,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-b876ef321839bf0878c23237: done: 0.326587 sec","job_status":"done","queue_duration_s":81.075066,"scheduling_latency_s":81.075098,"redis_calls":21,"redis_duration_s":0.008008000000000001,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.003661,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0023,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002047,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.047,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.035,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.256785,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00070368,"duration_s":0.326587,"completed_at":"2026-08-16T16:49:31.437Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.055594,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2095gitlab # [ 412.669081] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:31.440Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"8e28efc3283792e5cc2fe3d8","created_at":"2026-08-16T16:48:10.242Z","trace_propagation_headers":{"sentry-trace":"f289add8f8bf49dca6216e1942af5bf1-5c0b411b545640e9","baggage":"sentry-trace_id=f289add8f8bf49dca6216e1942af5bf1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QJEHE5J2KSZMP6F36R8T8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T16:48:10.251Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-8e28efc3283792e5cc2fe3d8: start","job_status":"start","queue_duration_s":81.18935,"scheduling_latency_s":81.189392}2096gitlab # [ 412.890698] gitaly[915]: time="2026-08-16T16:49:31.775Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QJEHE5J2KSZMP6F36R8T8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:49:31.774" grpc.time_ms=0.836 pid=915 span.kind=server system=grpc2097gitlab # [ 412.945602] gitaly[915]: time="2026-08-16T16:49:31.830Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QJEHE5J2KSZMP6F36R8T8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3895 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:49:31.830" grpc.time_ms=0.682 pid=915 span.kind=server system=grpc2098gitlab # [ 412.998135] gitaly[915]: time="2026-08-16T16:49:31.883Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QJEHE5J2KSZMP6F36R8T8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:49:31.882" grpc.time_ms=0.663 pid=915 span.kind=server system=grpc2099gitlab # [ 413.029228] gitaly[915]: time="2026-08-16T16:49:31.895Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05QJEHE5J2KSZMP6F36R8T8 diskcache=63423669-b86c-4807-bf26-0ad4414d8258 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T16:50:01.116" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:49:31.717" pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2100gitlab # [ 413.054378] gitaly[915]: time="2026-08-16T16:49:31.896Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=204 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7497 command.oublock=0 command.real_time_ms=172 command.spawn_token_fork_ms=1 command.system_time_ms=115 command.user_time_ms=89 component=gitaly.UnaryServerInterceptor correlation_id=01M05QJEHE5J2KSZMP6F36R8T8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T16:50:01.116" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:49:31.717" grpc.time_ms=179.038 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2101gitlab # [ 413.231056] gitaly[915]: time="2026-08-16T16:49:32.116Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QJEHE5J2KSZMP6F36R8T8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T16:50:02.014" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:49:32.114" grpc.time_ms=1.541 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2102gitlab # [ 413.316583] gitaly[915]: time="2026-08-16T16:49:32.201Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QJEHE5J2KSZMP6F36R8T8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:50:02.099" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:49:32.200" grpc.time_ms=1.259 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2103gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'2104gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.06 seconds)2105gitlab # [ 413.357362] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:32.241Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"8e28efc3283792e5cc2fe3d8","created_at":"2026-08-16T16:48:10.242Z","trace_propagation_headers":{"sentry-trace":"f289add8f8bf49dca6216e1942af5bf1-5c0b411b545640e9","baggage":"sentry-trace_id=f289add8f8bf49dca6216e1942af5bf1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QJEHE5J2KSZMP6F36R8T8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T16:48:10.251Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-8e28efc3283792e5cc2fe3d8: done: 0.801339 sec","job_status":"done","queue_duration_s":81.18935,"scheduling_latency_s":81.189392,"gitaly_calls":3,"gitaly_duration_s":0.193876,"redis_calls":117,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.043894,"redis_read_bytes":457,"redis_write_bytes":28000,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002161,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.002437,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.016055,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":25,"redis_queues_duration_s":0.005989,"redis_queues_read_bytes":36,"redis_queues_write_bytes":14494,"redis_queues_metadata_calls":21,"redis_queues_metadata_duration_s":0.010049,"redis_queues_metadata_read_bytes":32,"redis_queues_metadata_write_bytes":3370,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.001028,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000759,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003255,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.105,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.042,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.048,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.055,"db_ci_duration_s":0.05,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.474165,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.6762956,"duration_s":0.801339,"completed_at":"2026-08-16T16:49:32.241Z","load_balancing_strategy":"primary","db_duration_s":0.122884,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2106gitlab # [ 413.472910] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:32.245Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"0c691f6333d8833ad1a3af6d","created_at":"2026-08-16T16:49:29.269Z","trace_propagation_headers":{"sentry-trace":"3dc808433774479eb4f6f74ece1a7147-5b17a3f9f86a43d4","baggage":"sentry-trace_id=3dc808433774479eb4f6f74ece1a7147,sentry-release=Unknown"},"correlation_id":"01M05QJ87A61M882N27ZWSTC1E","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:29.287Z","job_size_bytes":46,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-0c691f6333d8833ad1a3af6d: start","job_status":"start","queue_duration_s":2.957281,"scheduling_latency_s":2.957318}2107gitlab # [ 413.497909] gitaly[915]: time="2026-08-16T16:49:32.336Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05QJ87A61M882N27ZWSTC1E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-08-16T22:49:32.324" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:49:32.325" grpc.time_ms=10.695 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2108gitlab # [ 413.531319] nixbot[3479]: INFO: ::ffff:127.0.0.1:38510 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK2109gitlab # [ 413.537077] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:32.405Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"0c691f6333d8833ad1a3af6d","created_at":"2026-08-16T16:49:29.269Z","trace_propagation_headers":{"sentry-trace":"3dc808433774479eb4f6f74ece1a7147-5b17a3f9f86a43d4","baggage":"sentry-trace_id=3dc808433774479eb4f6f74ece1a7147,sentry-release=Unknown"},"correlation_id":"01M05QJ87A61M882N27ZWSTC1E","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:29.287Z","job_size_bytes":46,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-0c691f6333d8833ad1a3af6d: done: 0.160967 sec","job_status":"done","queue_duration_s":2.957281,"scheduling_latency_s":2.957318,"gitaly_calls":2,"gitaly_duration_s":0.033094,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.010043,"redis_read_bytes":69,"redis_write_bytes":4888,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.002,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000761,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2116,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002814,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.003478,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00099,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.09846,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00051014,"duration_s":0.160967,"completed_at":"2026-08-16T16:49:32.405Z","load_balancing_strategy":"primary","db_duration_s":0.018792,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2110gitlab # [ 413.615141] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:32.408Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"f475ceced55612ec1ec07a8a","created_at":"2026-08-16T16:49:29.309Z","trace_propagation_headers":{"sentry-trace":"3dc808433774479eb4f6f74ece1a7147-5b17a3f9f86a43d4","baggage":"sentry-trace_id=3dc808433774479eb4f6f74ece1a7147,sentry-release=Unknown"},"correlation_id":"01M05QJ87A61M882N27ZWSTC1E","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:29.315Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-f475ceced55612ec1ec07a8a: start","job_status":"start","queue_duration_s":3.093383,"scheduling_latency_s":3.09341}2111gitlab # [ 413.637663] gitaly[915]: time="2026-08-16T16:49:32.364Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M05QJ87A61M882N27ZWSTC1E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-16T16:50:02.248" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:49:32.349" grpc.time_ms=15.258 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2112gitlab # [ 413.655170] gitaly[915]: time="2026-08-16T16:49:32.478Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05QJ87A61M882N27ZWSTC1E diskcache=d58d2432-73f6-4cfd-a12f-92db6a89dbe3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T22:49:32.441" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:49:32.442" pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2113gitlab # [ 413.668227] gitaly[915]: time="2026-08-16T16:49:32.479Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=26 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1173 command.oublock=0 command.real_time_ms=45 command.spawn_token_fork_ms=2 command.system_time_ms=26 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QJ87A61M882N27ZWSTC1E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T22:49:32.441" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:49:32.442" grpc.time_ms=36.619 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2114gitlab # [ 413.685759] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:32.547Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"f475ceced55612ec1ec07a8a","created_at":"2026-08-16T16:49:29.309Z","trace_propagation_headers":{"sentry-trace":"3dc808433774479eb4f6f74ece1a7147-5b17a3f9f86a43d4","baggage":"sentry-trace_id=3dc808433774479eb4f6f74ece1a7147,sentry-release=Unknown"},"correlation_id":"01M05QJ87A61M882N27ZWSTC1E","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:29.315Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-f475ceced55612ec1ec07a8a: done: 0.139232 sec","job_status":"done","queue_duration_s":3.093383,"scheduling_latency_s":3.09341,"gitaly_calls":1,"gitaly_duration_s":0.040026,"redis_calls":15,"redis_duration_s":0.005599,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000541,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002335,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00087,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001853,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.018,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.032,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.065203,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.09774938,"duration_s":0.139232,"completed_at":"2026-08-16T16:49:32.547Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025025,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2115gitlab # [ 413.733291] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:32.551Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"966c20e9fba3e8f0cbffd641","created_at":"2026-08-16T16:49:29.468Z","trace_propagation_headers":{"sentry-trace":"3dc808433774479eb4f6f74ece1a7147-5b17a3f9f86a43d4","baggage":"sentry-trace_id=3dc808433774479eb4f6f74ece1a7147,sentry-release=Unknown"},"correlation_id":"01M05QJ87A61M882N27ZWSTC1E","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:29.472Z","job_size_bytes":23,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-966c20e9fba3e8f0cbffd641: start","job_status":"start","queue_duration_s":3.078109,"scheduling_latency_s":3.078148}2116gitlab # [ 413.749005] gitaly[915]: time="2026-08-16T16:49:32.628Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=595 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QJ87A61M882N27ZWSTC1E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-16T16:50:02.008" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:49:32.608" grpc.time_ms=18.971 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2117gitlab # [ 413.764933] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:32.648Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"966c20e9fba3e8f0cbffd641","created_at":"2026-08-16T16:49:29.468Z","trace_propagation_headers":{"sentry-trace":"3dc808433774479eb4f6f74ece1a7147-5b17a3f9f86a43d4","baggage":"sentry-trace_id=3dc808433774479eb4f6f74ece1a7147,sentry-release=Unknown"},"correlation_id":"01M05QJ87A61M882N27ZWSTC1E","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:29.472Z","job_size_bytes":23,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-966c20e9fba3e8f0cbffd641: done: 0.09721 sec","job_status":"done","queue_duration_s":3.078109,"scheduling_latency_s":3.078148,"gitaly_calls":1,"gitaly_duration_s":0.022509,"redis_calls":16,"redis_duration_s":0.006727,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000494,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001909,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.003037,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001287,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.060431,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.09721,"completed_at":"2026-08-16T16:49:32.648Z","load_balancing_strategy":"primary","db_duration_s":0.00535,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2118gitlab # [ 413.810059] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:32.652Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"6f3a0e12ae24115c1f6c2dde","created_at":"2026-08-16T16:49:30.252Z","trace_propagation_headers":{"sentry-trace":"3dc808433774479eb4f6f74ece1a7147-5b17a3f9f86a43d4","baggage":"sentry-trace_id=3dc808433774479eb4f6f74ece1a7147,sentry-release=Unknown"},"correlation_id":"01M05QJ87A61M882N27ZWSTC1E","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:47f7f5b486bdaa41ca37d877c1f1bcdb208fe30fc5ee1dbebad86f3910ba96f9","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:30.264Z","job_size_bytes":467,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-6f3a0e12ae24115c1f6c2dde: start","job_status":"start","queue_duration_s":2.388751,"scheduling_latency_s":2.388799}2119gitlab # [ 413.827130] gitaly[915]: time="2026-08-16T16:49:32.705Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QJ87A61M882N27ZWSTC1E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:50:02.103" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:49:32.704" grpc.time_ms=0.997 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2120gitlab # [ 413.840471] gitaly[915]: time="2026-08-16T16:49:32.726Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QJ87A61M882N27ZWSTC1E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-16T16:49:42.168" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:49:32.709" grpc.time_ms=16.433 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2121gitlab # [ 414.050967] gitaly[915]: time="2026-08-16T16:49:32.935Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QJ87A61M882N27ZWSTC1E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T16:50:02.333" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:49:32.934" grpc.time_ms=1.241 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2122gitlab # [ 414.089057] gitaly[915]: time="2026-08-16T16:49:32.943Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=30 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QJ87A61M882N27ZWSTC1E error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-16T16:50:02.339" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:49:32.939" grpc.time_ms=3.938 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2123gitlab # [ 414.172288] gitaly[915]: time="2026-08-16T16:49:33.057Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05QJ87A61M882N27ZWSTC1E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T16:49:43.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:49:33.040" grpc.time_ms=17.291 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2124gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'2125gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.07 seconds)2126gitlab # [ 414.503181] nixbot[3479]: INFO: ::ffff:127.0.0.1:38522 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK2127gitlab # [ 414.970842] gitaly[915]: time="2026-08-16T16:49:33.856Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=884 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=1 command.system_time_ms=16 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05QJ87A61M882N27ZWSTC1E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-16T16:50:03.730" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:49:33.830" grpc.time_ms=25.208 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2128gitlab # [ 415.001372] gitaly[915]: time="2026-08-16T16:49:33.886Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05QJ87A61M882N27ZWSTC1E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-16T16:50:03.761" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:49:33.862" grpc.time_ms=24.572 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2129gitlab # [ 415.079029] sidekiq-cluster[3369]: {"severity":"WARN","time":"2026-08-16T16:49:33.963Z","class":"CreatePipelineWorker","correlation_id":"01M05QJ87A61M882N27ZWSTC1E","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"4d3fb0aba4d1486190be170ec06ddc76cff21d6f","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"4d3fb0aba4d1486190be170ec06ddc76cff21d6f","ref":"refs/heads/master"},"retry":0}2130gitlab # [ 415.100798] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:33.982Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"6f3a0e12ae24115c1f6c2dde","created_at":"2026-08-16T16:49:30.252Z","trace_propagation_headers":{"sentry-trace":"3dc808433774479eb4f6f74ece1a7147-5b17a3f9f86a43d4","baggage":"sentry-trace_id=3dc808433774479eb4f6f74ece1a7147,sentry-release=Unknown"},"correlation_id":"01M05QJ87A61M882N27ZWSTC1E","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:47f7f5b486bdaa41ca37d877c1f1bcdb208fe30fc5ee1dbebad86f3910ba96f9","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:30.264Z","job_size_bytes":467,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-6f3a0e12ae24115c1f6c2dde: done: 1.329493 sec","job_status":"done","queue_duration_s":2.388751,"scheduling_latency_s":2.388799,"gitaly_calls":7,"gitaly_duration_s":0.123785,"redis_calls":51,"redis_duration_s":0.015857,"redis_read_bytes":169,"redis_write_bytes":4167,"redis_cache_calls":4,"redis_cache_duration_s":0.00118,"redis_cache_read_bytes":10,"redis_cache_write_bytes":342,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.007362,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002254,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003253,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001808,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.047,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.04,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.120819,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00064476,"duration_s":1.329493,"completed_at":"2026-08-16T16:49:33.982Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.082614,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2131gitlab # [ 415.182504] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:33.985Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"c2c6aec9-5a42-4c0b-8012-22951663ede0\"}"],"class":"WebHookWorker","jid":"4c6c253f5dd5ff62a44d22c7","created_at":"2026-08-16T16:49:30.439Z","trace_propagation_headers":{"sentry-trace":"3dc808433774479eb4f6f74ece1a7147-5b17a3f9f86a43d4","baggage":"sentry-trace_id=3dc808433774479eb4f6f74ece1a7147,sentry-release=Unknown"},"correlation_id":"01M05QJ87A61M882N27ZWSTC1E","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:08b4b13da1b9909e57d91a5ba8c37472557db62ef806a5d483d9c0129b020679","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:30.445Z","job_size_bytes":1751,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-4c6c253f5dd5ff62a44d22c7: start","job_status":"start","queue_duration_s":3.540134,"scheduling_latency_s":3.540173}2132gitlab # [ 415.307419] nixbot[3479]: INFO: ::ffff:127.0.0.1:38536 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2133gitlab # [ 415.347492] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:34.231Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"c2c6aec9-5a42-4c0b-8012-22951663ede0\"}"],"class":"WebHookWorker","jid":"4c6c253f5dd5ff62a44d22c7","created_at":"2026-08-16T16:49:30.439Z","trace_propagation_headers":{"sentry-trace":"3dc808433774479eb4f6f74ece1a7147-5b17a3f9f86a43d4","baggage":"sentry-trace_id=3dc808433774479eb4f6f74ece1a7147,sentry-release=Unknown"},"correlation_id":"01M05QJ87A61M882N27ZWSTC1E","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:08b4b13da1b9909e57d91a5ba8c37472557db62ef806a5d483d9c0129b020679","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:30.445Z","job_size_bytes":1751,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-4c6c253f5dd5ff62a44d22c7: done: 0.246395 sec","job_status":"done","queue_duration_s":3.540134,"scheduling_latency_s":3.540173,"redis_calls":19,"redis_duration_s":0.006946,"redis_read_bytes":32,"redis_write_bytes":5368,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001669,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.001021,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3730,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002874,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001382,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.0872156799999857,"cpu_s":0.134514,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00073016,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.246395,"completed_at":"2026-08-16T16:49:34.231Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005056,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2134gitlab # [ 415.460143] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:34.235Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"bc31dd6db2209cf33d20544f","created_at":"2026-08-16T16:49:30.599Z","trace_propagation_headers":{"sentry-trace":"d63357342b9d43fe9f686ac1be98fc6d-444299465d094821","baggage":"sentry-trace_id=d63357342b9d43fe9f686ac1be98fc6d,sentry-release=Unknown"},"correlation_id":"01M05QJDGY15739NMS0VRRZ16G","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"f475ceced55612ec1ec07a8a","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:30.604Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-bc31dd6db2209cf33d20544f: start","job_status":"start","queue_duration_s":3.630404,"scheduling_latency_s":3.630446}2135gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'2136gitlab # [ 415.481074] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:34.332Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"bc31dd6db2209cf33d20544f","created_at":"2026-08-16T16:49:30.599Z","trace_propagation_headers":{"sentry-trace":"d63357342b9d43fe9f686ac1be98fc6d-444299465d094821","baggage":"sentry-trace_id=d63357342b9d43fe9f686ac1be98fc6d,sentry-release=Unknown"},"correlation_id":"01M05QJDGY15739NMS0VRRZ16G","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"f475ceced55612ec1ec07a8a","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:30.604Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-bc31dd6db2209cf33d20544f: done: 0.097456 sec","job_status":"done","queue_duration_s":3.630404,"scheduling_latency_s":3.630446,"gitaly_calls":1,"gitaly_duration_s":0.032462,"redis_calls":12,"redis_duration_s":0.003506,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00149,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000567,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001449,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.013,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.013,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050211,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.06108556,"duration_s":0.097456,"completed_at":"2026-08-16T16:49:34.332Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009636,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2137gitlab # [ 415.528830] gitaly[915]: time="2026-08-16T16:49:34.280Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05QJDGY15739NMS0VRRZ16G diskcache=ad79b64a-19a8-4bc5-8505-44476c3c40f1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T22:49:34.267" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:49:34.267" pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2138gitlab # [ 415.538778] gitaly[915]: time="2026-08-16T16:49:34.281Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=290 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QJDGY15739NMS0VRRZ16G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T22:49:34.267" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:49:34.267" grpc.time_ms=13.213 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2139gitlab # [ 415.552388] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:49:34 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1422140gitlab # [ 415.554499] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:34.335Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"ebcd7f194fe7276310d0a837","created_at":"2026-08-16T16:49:30.813Z","trace_propagation_headers":{"sentry-trace":"d63357342b9d43fe9f686ac1be98fc6d-444299465d094821","baggage":"sentry-trace_id=d63357342b9d43fe9f686ac1be98fc6d,sentry-release=Unknown"},"correlation_id":"01M05QJDGY15739NMS0VRRZ16G","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:81893fe4eb871c0963c13a775f685e75459a2c05f45fd0ddd626642bd40281e0","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:30.818Z","job_size_bytes":467,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-ebcd7f194fe7276310d0a837: start","job_status":"start","queue_duration_s":3.516759,"scheduling_latency_s":3.516794}2141gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.07 seconds)2142gitlab # [ 415.572449] gitaly[915]: time="2026-08-16T16:49:34.373Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QJDGY15739NMS0VRRZ16G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:50:04.272" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:49:34.372" grpc.time_ms=0.779 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2143gitlab # [ 415.584852] nixbot[3479]: INFO: ::ffff:127.0.0.1:38548 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK2144gitlab # [ 415.586717] gitaly[915]: time="2026-08-16T16:49:34.382Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=3 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05QN1H06Y5JSB4KY307YRFJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:49:34.361" grpc.time_ms=20.112 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc2145gitlab # [ 415.600109] gitaly[915]: time="2026-08-16T16:49:34.388Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05QJDGY15739NMS0VRRZ16G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-16T16:49:44.006" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:49:34.376" grpc.time_ms=11.55 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2146gitlab # [ 415.613313] gitaly[915]: time="2026-08-16T16:49:34.450Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QJDGY15739NMS0VRRZ16G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T16:50:04.349" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:49:34.449" grpc.time_ms=1.14 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2147gitlab # [ 415.626003] gitaly[915]: time="2026-08-16T16:49:34.459Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=34 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QJDGY15739NMS0VRRZ16G error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-16T16:50:04.356" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:49:34.456" grpc.time_ms=3.099 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2148gitlab # [ 415.642288] gitlab-workhorse[822]: time="2026-08-16T16:49:34Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672149gitlab # [ 415.644131] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:49:34 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1152150gitlab # [ 415.646013] gitaly[915]: time="2026-08-16T16:49:34.499Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05QN1NGA02KHEFMQRTPWD81 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:49:34.487" pid=915 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2151gitlab # [ 415.656508] gitaly[915]: time="2026-08-16T16:49:34.499Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05QN1NGA02KHEFMQRTPWD81 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:49:34.487" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc2152gitlab # [ 415.669696] nixbot[3479]: {"ts": "2026-08-16T16:49:34.537Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2153gitlab # [ 415.672123] gitaly[915]: time="2026-08-16T16:49:34.500Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05QN1NGA02KHEFMQRTPWD81 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:49:34.487" grpc.time_ms=12.626 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc2154gitlab # [ 415.686590] gitaly[915]: time="2026-08-16T16:49:34.512Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QJDGY15739NMS0VRRZ16G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T16:49:44.127" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:49:34.498" grpc.time_ms=13.684 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2155gitlab # [ 415.823773] gitaly[915]: time="2026-08-16T16:49:34.709Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QN1TP1CPQYH9VYE32SXKW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:50:04.706" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:49:34.707" grpc.time_ms=1.205 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2156gitlab # [ 415.936176] gitaly[915]: time="2026-08-16T16:49:34.821Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05QN1TP1CPQYH9VYE32SXKW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T16:49:44.145" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:49:34.806" grpc.time_ms=14.964 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2157gitlab # [ 416.020723] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:49:34 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4d3fb0aba4d1486190be170ec06ddc76cff21d6f HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 3552158gitlab # [ 416.028740] nixbot[3479]: {"ts": "2026-08-16T16:49:34.907Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4d3fb0aba4d1486190be170ec06ddc76cff21d6f \"HTTP/1.1 201 Created\""}2159gitlab # [ 416.123367] gitaly[915]: time="2026-08-16T16:49:35.008Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QN25Z5Y4HNQM4TZ8FTW5T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:50:05.006" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:49:35.007" grpc.time_ms=1.188 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2160gitlab # [ 416.210625] gitaly[915]: time="2026-08-16T16:49:35.096Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05QN25Z5Y4HNQM4TZ8FTW5T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T16:49:45.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:49:35.078" grpc.time_ms=17.591 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2161gitlab # [ 416.308193] gitaly[915]: time="2026-08-16T16:49:35.192Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=881 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=2 command.system_time_ms=18 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QJDGY15739NMS0VRRZ16G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-16T16:50:05.067" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:49:35.167" grpc.time_ms=24.697 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2162gitlab # [ 416.345898] gitaly[915]: time="2026-08-16T16:49:35.220Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=4 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M05QJDGY15739NMS0VRRZ16G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-16T16:50:05.095" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:49:35.196" grpc.time_ms=24.341 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2163gitlab # [ 416.370826] nixbot[3479]: {"ts": "2026-08-16T16:49:35.211Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4d3fb0aba4d1486190be170ec06ddc76cff21d6f \"HTTP/1.1 201 Created\""}2164gitlab # [ 416.375939] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:49:35 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4d3fb0aba4d1486190be170ec06ddc76cff21d6f HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2982165gitlab # [ 416.380760] sidekiq-cluster[3369]: {"severity":"WARN","time":"2026-08-16T16:49:35.233Z","class":"CreatePipelineWorker","correlation_id":"01M05QJDGY15739NMS0VRRZ16G","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"4d3fb0aba4d1486190be170ec06ddc76cff21d6f","after":"82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33","ref":"refs/heads/master"},"retry":0}2166gitlab # [ 416.391347] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:35.239Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"ebcd7f194fe7276310d0a837","created_at":"2026-08-16T16:49:30.813Z","trace_propagation_headers":{"sentry-trace":"d63357342b9d43fe9f686ac1be98fc6d-444299465d094821","baggage":"sentry-trace_id=d63357342b9d43fe9f686ac1be98fc6d,sentry-release=Unknown"},"correlation_id":"01M05QJDGY15739NMS0VRRZ16G","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:81893fe4eb871c0963c13a775f685e75459a2c05f45fd0ddd626642bd40281e0","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:30.818Z","job_size_bytes":467,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-ebcd7f194fe7276310d0a837: done: 0.904622 sec","job_status":"done","queue_duration_s":3.516759,"scheduling_latency_s":3.516794,"gitaly_calls":7,"gitaly_duration_s":0.100918,"redis_calls":33,"redis_duration_s":0.008496,"redis_read_bytes":185,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000851,"redis_cache_read_bytes":44,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001316,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.005151,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001178,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.033,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.03,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.776771,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.904622,"completed_at":"2026-08-16T16:49:35.239Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.032348,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2167gitlab # [ 416.450319] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:35.241Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"c99980f1-59bc-47a5-a54b-684252cc6517\"}"],"class":"WebHookWorker","jid":"bbd95328a65d91488839f933","created_at":"2026-08-16T16:49:30.852Z","trace_propagation_headers":{"sentry-trace":"d63357342b9d43fe9f686ac1be98fc6d-444299465d094821","baggage":"sentry-trace_id=d63357342b9d43fe9f686ac1be98fc6d,sentry-release=Unknown"},"correlation_id":"01M05QJDGY15739NMS0VRRZ16G","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:240805bcb15e0df4589fe235a6f04b2b5241aa20315b3338f525ce48d8fc6fe5","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:30.857Z","job_size_bytes":1749,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-bbd95328a65d91488839f933: start","job_status":"start","queue_duration_s":4.383956,"scheduling_latency_s":4.383978}2168gitlab # [ 416.469197] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:35.320Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"c99980f1-59bc-47a5-a54b-684252cc6517\"}"],"class":"WebHookWorker","jid":"bbd95328a65d91488839f933","created_at":"2026-08-16T16:49:30.852Z","trace_propagation_headers":{"sentry-trace":"d63357342b9d43fe9f686ac1be98fc6d-444299465d094821","baggage":"sentry-trace_id=d63357342b9d43fe9f686ac1be98fc6d,sentry-release=Unknown"},"correlation_id":"01M05QJDGY15739NMS0VRRZ16G","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:240805bcb15e0df4589fe235a6f04b2b5241aa20315b3338f525ce48d8fc6fe5","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:30.857Z","job_size_bytes":1749,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-bbd95328a65d91488839f933: done: 0.078833 sec","job_status":"done","queue_duration_s":4.383956,"scheduling_latency_s":4.383978,"redis_calls":14,"redis_duration_s":0.007584,"redis_read_bytes":26,"redis_write_bytes":4683,"redis_queues_calls":2,"redis_queues_duration_s":0.002152,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3727,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003554,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001878,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.01392279999998891,"cpu_s":0.045196,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.078833,"completed_at":"2026-08-16T16:49:35.320Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00682,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2169gitlab # [ 416.516772] nixbot[3479]: INFO: ::ffff:127.0.0.1:38558 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2170gitlab # [ 416.518035] gitaly[915]: time="2026-08-16T16:49:35.291Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QN2FHDVY7C2Q81HS3FF5E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:50:05.290" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:49:35.290" grpc.time_ms=0.742 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2171gitlab # [ 416.530923] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:35.326Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"57eb69f9d49dd11df384c382","created_at":"2026-08-16T16:49:31.686Z","trace_propagation_headers":{"sentry-trace":"f289add8f8bf49dca6216e1942af5bf1-5b7e130ea1ca44b6","baggage":"sentry-trace_id=f289add8f8bf49dca6216e1942af5bf1,sentry-release=Unknown"},"correlation_id":"01M05QJEHE5J2KSZMP6F36R8T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:31.695Z","job_size_bytes":23,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-57eb69f9d49dd11df384c382: start","job_status":"start","queue_duration_s":3.630417,"scheduling_latency_s":3.630437}2172gitlab # [ 416.548229] gitaly[915]: time="2026-08-16T16:49:35.368Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01M05QN2FHDVY7C2Q81HS3FF5E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T16:49:45.203" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:49:35.353" grpc.time_ms=14.672 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2173gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'2174gitlab # [ 416.561718] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:35.432Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"57eb69f9d49dd11df384c382","created_at":"2026-08-16T16:49:31.686Z","trace_propagation_headers":{"sentry-trace":"f289add8f8bf49dca6216e1942af5bf1-5b7e130ea1ca44b6","baggage":"sentry-trace_id=f289add8f8bf49dca6216e1942af5bf1,sentry-release=Unknown"},"correlation_id":"01M05QJEHE5J2KSZMP6F36R8T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:31.695Z","job_size_bytes":23,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-57eb69f9d49dd11df384c382: done: 0.106211 sec","job_status":"done","queue_duration_s":3.630417,"scheduling_latency_s":3.630437,"redis_calls":10,"redis_duration_s":0.002269,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000292,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00116,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000817,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.070798,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00030284,"duration_s":0.106211,"completed_at":"2026-08-16T16:49:35.432Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.024883,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2175gitlab # [ 416.606729] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:35.434Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"1bc4504c21a436fda4399162","created_at":"2026-08-16T16:49:31.908Z","trace_propagation_headers":{"sentry-trace":"f289add8f8bf49dca6216e1942af5bf1-5b7e130ea1ca44b6","baggage":"sentry-trace_id=f289add8f8bf49dca6216e1942af5bf1,sentry-release=Unknown"},"correlation_id":"01M05QJEHE5J2KSZMP6F36R8T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:31.919Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-1bc4504c21a436fda4399162: start","job_status":"start","queue_duration_s":3.514945,"scheduling_latency_s":3.514967}2176gitlab # [ 416.624624] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:49:35 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1052177gitlab # [ 416.626681] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:49:35 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4d3fb0aba4d1486190be170ec06ddc76cff21d6f HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2522178gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.06 seconds)2179gitlab # [ 416.629467] gitaly[915]: time="2026-08-16T16:49:35.442Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=5 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05QN2KACK1TN1TB27TGVM2A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:49:35.428" grpc.time_ms=13.099 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc2180gitlab # [ 416.642654] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:35.477Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"1bc4504c21a436fda4399162","created_at":"2026-08-16T16:49:31.908Z","trace_propagation_headers":{"sentry-trace":"f289add8f8bf49dca6216e1942af5bf1-5b7e130ea1ca44b6","baggage":"sentry-trace_id=f289add8f8bf49dca6216e1942af5bf1,sentry-release=Unknown"},"correlation_id":"01M05QJEHE5J2KSZMP6F36R8T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:31.919Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-1bc4504c21a436fda4399162: done: 0.043766 sec","job_status":"done","queue_duration_s":3.514945,"scheduling_latency_s":3.514967,"redis_calls":10,"redis_duration_s":0.005136,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003263,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0015,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000373,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028374,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0006691,"duration_s":0.043766,"completed_at":"2026-08-16T16:49:35.477Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005946,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2181gitlab # [ 416.687665] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:35.480Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"9a065c4624e66ffdfdfb263f","created_at":"2026-08-16T16:49:31.943Z","trace_propagation_headers":{"sentry-trace":"f289add8f8bf49dca6216e1942af5bf1-5b7e130ea1ca44b6","baggage":"sentry-trace_id=f289add8f8bf49dca6216e1942af5bf1,sentry-release=Unknown"},"correlation_id":"01M05QJEHE5J2KSZMP6F36R8T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:31.954Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-9a065c4624e66ffdfdfb263f: start","job_status":"start","queue_duration_s":3.526219,"scheduling_latency_s":3.526241}2182gitlab # [ 416.703992] nixbot[3479]: {"ts": "2026-08-16T16:49:35.471Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4d3fb0aba4d1486190be170ec06ddc76cff21d6f \"HTTP/1.1 201 Created\""}2183gitlab # [ 416.706719] nixbot[3479]: INFO: ::ffff:127.0.0.1:38560 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK2184gitlab # [ 416.708697] gitlab-workhorse[822]: time="2026-08-16T16:49:35Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672185gitlab # [ 416.710489] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:49:35 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 882186gitlab # [ 416.712379] gitaly[915]: time="2026-08-16T16:49:35.532Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05QN2PMWWHQZARW5ERB26JS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:49:35.522" pid=915 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2187gitlab # [ 416.722495] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:35.524Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"9a065c4624e66ffdfdfb263f","created_at":"2026-08-16T16:49:31.943Z","trace_propagation_headers":{"sentry-trace":"f289add8f8bf49dca6216e1942af5bf1-5b7e130ea1ca44b6","baggage":"sentry-trace_id=f289add8f8bf49dca6216e1942af5bf1,sentry-release=Unknown"},"correlation_id":"01M05QJEHE5J2KSZMP6F36R8T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:31.954Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-9a065c4624e66ffdfdfb263f: done: 0.044109 sec","job_status":"done","queue_duration_s":3.526219,"scheduling_latency_s":3.526241,"redis_calls":10,"redis_duration_s":0.004047,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000407,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003177,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000463,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029801,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037276,"duration_s":0.044109,"completed_at":"2026-08-16T16:49:35.524Z","load_balancing_strategy":"primary","db_duration_s":0.005981,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2188gitlab # [ 416.766712] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:35.526Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"d25be0c5e146a9c23d081853","created_at":"2026-08-16T16:49:31.978Z","trace_propagation_headers":{"sentry-trace":"f289add8f8bf49dca6216e1942af5bf1-5b7e130ea1ca44b6","baggage":"sentry-trace_id=f289add8f8bf49dca6216e1942af5bf1,sentry-release=Unknown"},"correlation_id":"01M05QJEHE5J2KSZMP6F36R8T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:31.986Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-d25be0c5e146a9c23d081853: start","job_status":"start","queue_duration_s":3.540441,"scheduling_latency_s":3.540462}2189gitlab # [ 416.783875] gitaly[915]: time="2026-08-16T16:49:35.532Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05QN2PMWWHQZARW5ERB26JS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:49:35.522" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc2190gitlab # [ 416.798524] nix-daemon[3693]: accepted connection from pid 4242, user nixbot2191gitlab # [ 416.799690] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:35.575Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"d25be0c5e146a9c23d081853","created_at":"2026-08-16T16:49:31.978Z","trace_propagation_headers":{"sentry-trace":"f289add8f8bf49dca6216e1942af5bf1-5b7e130ea1ca44b6","baggage":"sentry-trace_id=f289add8f8bf49dca6216e1942af5bf1,sentry-release=Unknown"},"correlation_id":"01M05QJEHE5J2KSZMP6F36R8T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:31.986Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-d25be0c5e146a9c23d081853: done: 0.049173 sec","job_status":"done","queue_duration_s":3.540441,"scheduling_latency_s":3.540462,"redis_calls":13,"redis_duration_s":0.00454,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001737,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00135,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000944,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000509,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033025,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00046612,"duration_s":0.049173,"completed_at":"2026-08-16T16:49:35.575Z","load_balancing_strategy":"primary","db_duration_s":0.0058,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2192gitlab # [ 416.848660] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:35.577Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"04546e12cab54934b4ae8300","created_at":"2026-08-16T16:49:31.987Z","trace_propagation_headers":{"sentry-trace":"f289add8f8bf49dca6216e1942af5bf1-5b7e130ea1ca44b6","baggage":"sentry-trace_id=f289add8f8bf49dca6216e1942af5bf1,sentry-release=Unknown"},"correlation_id":"01M05QJEHE5J2KSZMP6F36R8T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:31.996Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-04546e12cab54934b4ae8300: start","job_status":"start","queue_duration_s":3.581186,"scheduling_latency_s":3.581207}2193gitlab # [ 416.865872] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:49:35 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 832194gitlab # [ 416.867896] gitlab-workhorse[822]: time="2026-08-16T16:49:35Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672195gitlab # [ 416.869995] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:49:35 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 792196gitlab # [ 416.871851] gitaly[915]: time="2026-08-16T16:49:35.534Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05QN2PMWWHQZARW5ERB26JS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:49:35.522" grpc.time_ms=10.731 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc2197gitlab # [ 416.886730] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:35.620Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"04546e12cab54934b4ae8300","created_at":"2026-08-16T16:49:31.987Z","trace_propagation_headers":{"sentry-trace":"f289add8f8bf49dca6216e1942af5bf1-5b7e130ea1ca44b6","baggage":"sentry-trace_id=f289add8f8bf49dca6216e1942af5bf1,sentry-release=Unknown"},"correlation_id":"01M05QJEHE5J2KSZMP6F36R8T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:31.996Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-04546e12cab54934b4ae8300: done: 0.043007 sec","job_status":"done","queue_duration_s":3.581186,"scheduling_latency_s":3.581207,"redis_calls":10,"redis_duration_s":0.005761,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000854,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00452,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000387,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027122,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002578,"duration_s":0.043007,"completed_at":"2026-08-16T16:49:35.620Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005114,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2198gitlab # [ 416.933190] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:35.622Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"70ec651538920c58654a4d67","created_at":"2026-08-16T16:49:31.997Z","trace_propagation_headers":{"sentry-trace":"f289add8f8bf49dca6216e1942af5bf1-5b7e130ea1ca44b6","baggage":"sentry-trace_id=f289add8f8bf49dca6216e1942af5bf1,sentry-release=Unknown"},"correlation_id":"01M05QJEHE5J2KSZMP6F36R8T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:32.005Z","job_size_bytes":19,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-70ec651538920c58654a4d67: start","job_status":"start","queue_duration_s":3.616943,"scheduling_latency_s":3.616962}2199gitlab # [ 416.949921] gitaly[915]: time="2026-08-16T16:49:35.652Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M05QN2THJGQB8A5GS329KBW1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:49:35.643" grpc.time_ms=8.866 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc2200gitlab # [ 416.963296] gitaly[915]: time="2026-08-16T16:49:35.733Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05QN2X64AVFTQYDGB0KK942 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:49:35.725" pid=915 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2201gitlab # [ 416.974800] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:49:35 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 622202gitlab # [ 416.976975] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:35.663Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"70ec651538920c58654a4d67","created_at":"2026-08-16T16:49:31.997Z","trace_propagation_headers":{"sentry-trace":"f289add8f8bf49dca6216e1942af5bf1-5b7e130ea1ca44b6","baggage":"sentry-trace_id=f289add8f8bf49dca6216e1942af5bf1,sentry-release=Unknown"},"correlation_id":"01M05QJEHE5J2KSZMP6F36R8T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:32.005Z","job_size_bytes":19,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-70ec651538920c58654a4d67: done: 0.041642 sec","job_status":"done","queue_duration_s":3.616943,"scheduling_latency_s":3.616962,"redis_calls":11,"redis_duration_s":0.007198,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003164,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003239,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000795,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023435,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0017414,"duration_s":0.041642,"completed_at":"2026-08-16T16:49:35.663Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004832,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2203gitlab # [ 417.021618] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:35.666Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"9f66e9e264a1aecd6c90ae85","created_at":"2026-08-16T16:49:32.009Z","trace_propagation_headers":{"sentry-trace":"f289add8f8bf49dca6216e1942af5bf1-5b7e130ea1ca44b6","baggage":"sentry-trace_id=f289add8f8bf49dca6216e1942af5bf1,sentry-release=Unknown"},"correlation_id":"01M05QJEHE5J2KSZMP6F36R8T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:32.020Z","job_size_bytes":66,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-9f66e9e264a1aecd6c90ae85: start","job_status":"start","queue_duration_s":3.646309,"scheduling_latency_s":3.646331}2204gitlab # [ 417.040304] gitaly[915]: time="2026-08-16T16:49:35.733Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M05QN2X64AVFTQYDGB0KK942 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:49:35.725" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc2205gitlab # [ 417.053283] gitlab-workhorse[822]: time="2026-08-16T16:49:35Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2162206gitlab # [ 417.055403] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:49:35 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 812207gitlab # [ 417.057747] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:35.710Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"9f66e9e264a1aecd6c90ae85","created_at":"2026-08-16T16:49:32.009Z","trace_propagation_headers":{"sentry-trace":"f289add8f8bf49dca6216e1942af5bf1-5b7e130ea1ca44b6","baggage":"sentry-trace_id=f289add8f8bf49dca6216e1942af5bf1,sentry-release=Unknown"},"correlation_id":"01M05QJEHE5J2KSZMP6F36R8T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:32.020Z","job_size_bytes":66,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-9f66e9e264a1aecd6c90ae85: done: 0.043633 sec","job_status":"done","queue_duration_s":3.646309,"scheduling_latency_s":3.646331,"redis_calls":10,"redis_duration_s":0.006338,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003435,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002008,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000895,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026833,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032178,"duration_s":0.043633,"completed_at":"2026-08-16T16:49:35.710Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006057,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2208gitlab # [ 417.103098] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:35.713Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"8776c6ae39abb2973080249f","created_at":"2026-08-16T16:49:32.022Z","trace_propagation_headers":{"sentry-trace":"f289add8f8bf49dca6216e1942af5bf1-5b7e130ea1ca44b6","baggage":"sentry-trace_id=f289add8f8bf49dca6216e1942af5bf1,sentry-release=Unknown"},"correlation_id":"01M05QJEHE5J2KSZMP6F36R8T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:32.034Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-8776c6ae39abb2973080249f: start","job_status":"start","queue_duration_s":3.678958,"scheduling_latency_s":3.678976}2209gitlab # [ 417.120130] gitaly[915]: time="2026-08-16T16:49:35.733Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M05QN2X64AVFTQYDGB0KK942 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:49:35.725" grpc.time_ms=8.468 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc2210gitlab # [ 417.134363] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:35.756Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"8776c6ae39abb2973080249f","created_at":"2026-08-16T16:49:32.022Z","trace_propagation_headers":{"sentry-trace":"f289add8f8bf49dca6216e1942af5bf1-5b7e130ea1ca44b6","baggage":"sentry-trace_id=f289add8f8bf49dca6216e1942af5bf1,sentry-release=Unknown"},"correlation_id":"01M05QJEHE5J2KSZMP6F36R8T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:32.034Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-8776c6ae39abb2973080249f: done: 0.043366 sec","job_status":"done","queue_duration_s":3.678958,"scheduling_latency_s":3.678976,"redis_calls":10,"redis_duration_s":0.001522,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000297,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000909,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000316,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031962,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00027938,"duration_s":0.043366,"completed_at":"2026-08-16T16:49:35.756Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005334,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2211gitlab # [ 417.179026] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:35.758Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"04efe726e6f826ce6f3e2d6a","created_at":"2026-08-16T16:49:32.049Z","trace_propagation_headers":{"sentry-trace":"f289add8f8bf49dca6216e1942af5bf1-5b7e130ea1ca44b6","baggage":"sentry-trace_id=f289add8f8bf49dca6216e1942af5bf1,sentry-release=Unknown"},"correlation_id":"01M05QJEHE5J2KSZMP6F36R8T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:32.061Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-04efe726e6f826ce6f3e2d6a: start","job_status":"start","queue_duration_s":3.697161,"scheduling_latency_s":3.697181}2212gitlab # [ 417.196797] gitaly[915]: time="2026-08-16T16:49:35.827Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=3 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M05QN30NCPS3APCYMGBBK2CC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:49:35.817" grpc.time_ms=9.824 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc2213gitlab # [ 417.210179] gitaly[915]: time="2026-08-16T16:49:35.910Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05QN32PV2WNE6FA0M5C6N0S grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:49:35.882" pid=915 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc2214gitlab # [ 417.220481] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:35.796Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"04efe726e6f826ce6f3e2d6a","created_at":"2026-08-16T16:49:32.049Z","trace_propagation_headers":{"sentry-trace":"f289add8f8bf49dca6216e1942af5bf1-5b7e130ea1ca44b6","baggage":"sentry-trace_id=f289add8f8bf49dca6216e1942af5bf1,sentry-release=Unknown"},"correlation_id":"01M05QJEHE5J2KSZMP6F36R8T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:32.061Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-04efe726e6f826ce6f3e2d6a: done: 0.038661 sec","job_status":"done","queue_duration_s":3.697161,"scheduling_latency_s":3.697181,"redis_calls":10,"redis_duration_s":0.002896,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001543,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000956,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000397,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024311,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023598,"duration_s":0.038661,"completed_at":"2026-08-16T16:49:35.796Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007272,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2215gitlab # [ 417.265892] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:35.798Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"178382ed839aed4ffa061f0d","created_at":"2026-08-16T16:49:32.062Z","trace_propagation_headers":{"sentry-trace":"f289add8f8bf49dca6216e1942af5bf1-5b7e130ea1ca44b6","baggage":"sentry-trace_id=f289add8f8bf49dca6216e1942af5bf1,sentry-release=Unknown"},"correlation_id":"01M05QJEHE5J2KSZMP6F36R8T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:32.070Z","job_size_bytes":6,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-178382ed839aed4ffa061f0d: start","job_status":"start","queue_duration_s":3.728208,"scheduling_latency_s":3.728227}2216gitlab # [ 417.282005] gitaly[915]: time="2026-08-16T16:49:35.910Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1102 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=6 command.system_time_ms=10 command.user_time_ms=8 component=gitaly.UnaryServerInterceptor correlation_id=01M05QN32PV2WNE6FA0M5C6N0S grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:49:35.882" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc2217gitlab # [ 417.296120] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:35.822Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"178382ed839aed4ffa061f0d","created_at":"2026-08-16T16:49:32.062Z","trace_propagation_headers":{"sentry-trace":"f289add8f8bf49dca6216e1942af5bf1-5b7e130ea1ca44b6","baggage":"sentry-trace_id=f289add8f8bf49dca6216e1942af5bf1,sentry-release=Unknown"},"correlation_id":"01M05QJEHE5J2KSZMP6F36R8T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:32.070Z","job_size_bytes":6,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-178382ed839aed4ffa061f0d: done: 0.024202 sec","job_status":"done","queue_duration_s":3.728208,"scheduling_latency_s":3.728227,"redis_calls":10,"redis_duration_s":0.001353,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000256,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000806,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000291,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01497,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026086,"duration_s":0.024202,"completed_at":"2026-08-16T16:49:35.822Z","load_balancing_strategy":"primary","db_duration_s":0.002015,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2218gitlab # [ 417.340971] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:35.824Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"a8d8d5bc71ab4e513c4f4963","created_at":"2026-08-16T16:49:32.071Z","trace_propagation_headers":{"sentry-trace":"f289add8f8bf49dca6216e1942af5bf1-5b7e130ea1ca44b6","baggage":"sentry-trace_id=f289add8f8bf49dca6216e1942af5bf1,sentry-release=Unknown"},"correlation_id":"01M05QJEHE5J2KSZMP6F36R8T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:32.078Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-a8d8d5bc71ab4e513c4f4963: start","job_status":"start","queue_duration_s":3.745448,"scheduling_latency_s":3.745464}2219gitlab # [ 417.356524] gitaly[915]: time="2026-08-16T16:49:35.910Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1102 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=6 command.system_time_ms=10 command.user_time_ms=8 component=gitaly.UnaryServerInterceptor correlation_id=01M05QN32PV2WNE6FA0M5C6N0S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:49:35.882" grpc.time_ms=28.342 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc2220gitlab # [ 417.371736] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:35.866Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"a8d8d5bc71ab4e513c4f4963","created_at":"2026-08-16T16:49:32.071Z","trace_propagation_headers":{"sentry-trace":"f289add8f8bf49dca6216e1942af5bf1-5b7e130ea1ca44b6","baggage":"sentry-trace_id=f289add8f8bf49dca6216e1942af5bf1,sentry-release=Unknown"},"correlation_id":"01M05QJEHE5J2KSZMP6F36R8T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:32.078Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-a8d8d5bc71ab4e513c4f4963: done: 0.042364 sec","job_status":"done","queue_duration_s":3.745448,"scheduling_latency_s":3.745464,"redis_calls":10,"redis_duration_s":0.001395,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000259,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000783,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000353,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02568,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000225,"duration_s":0.042364,"completed_at":"2026-08-16T16:49:35.866Z","load_balancing_strategy":"primary","db_duration_s":0.011058,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2221gitlab # [ 417.417894] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:35.868Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"5d83dade50ec53b8310bc458","created_at":"2026-08-16T16:49:32.088Z","trace_propagation_headers":{"sentry-trace":"f289add8f8bf49dca6216e1942af5bf1-5b7e130ea1ca44b6","baggage":"sentry-trace_id=f289add8f8bf49dca6216e1942af5bf1,sentry-release=Unknown"},"correlation_id":"01M05QJEHE5J2KSZMP6F36R8T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:32.096Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-5d83dade50ec53b8310bc458: start","job_status":"start","queue_duration_s":3.771755,"scheduling_latency_s":3.771771}2222gitlab # [ 417.434043] gitaly[915]: time="2026-08-16T16:49:36.047Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QN36NF2S1Y0DMKVKY9TX3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:50:06.045" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:49:36.046" grpc.time_ms=0.774 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2223gitlab # [ 417.447117] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:35.951Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"5d83dade50ec53b8310bc458","created_at":"2026-08-16T16:49:32.088Z","trace_propagation_headers":{"sentry-trace":"f289add8f8bf49dca6216e1942af5bf1-5b7e130ea1ca44b6","baggage":"sentry-trace_id=f289add8f8bf49dca6216e1942af5bf1,sentry-release=Unknown"},"correlation_id":"01M05QJEHE5J2KSZMP6F36R8T8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:32.096Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-5d83dade50ec53b8310bc458: done: 0.083338 sec","job_status":"done","queue_duration_s":3.771755,"scheduling_latency_s":3.771771,"redis_calls":14,"redis_duration_s":0.003665,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000259,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00197,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001436,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048387,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00040136,"duration_s":0.083338,"completed_at":"2026-08-16T16:49:35.951Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.023056,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2224gitlab # [ 417.491777] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:35.954Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"560abeca37691df833b4b534","created_at":"2026-08-16T16:49:32.378Z","trace_propagation_headers":{"sentry-trace":"3dc808433774479eb4f6f74ece1a7147-4c4f68adae034ef3","baggage":"sentry-trace_id=3dc808433774479eb4f6f74ece1a7147,sentry-release=Unknown"},"correlation_id":"01M05QJ87A61M882N27ZWSTC1E","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:32.386Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-560abeca37691df833b4b534: start","job_status":"start","queue_duration_s":3.567697,"scheduling_latency_s":3.567717}2225gitlab # [ 417.508174] gitaly[915]: time="2026-08-16T16:49:36.081Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=591 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M05QN36NF2S1Y0DMKVKY9TX3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-16T16:50:06.059" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:49:36.060" grpc.time_ms=21.47 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2226gitlab # [ 417.522134] nixbot[3479]: {"ts": "2026-08-16T16:49:36.381Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 \"HTTP/1.1 201 Created\""}2227gitlab # [ 417.524902] nixbot[3479]: {"ts": "2026-08-16T16:49:36.389Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-82d436ddd9f2-4"}2228gitlab # [ 417.527180] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:36.009Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"560abeca37691df833b4b534","created_at":"2026-08-16T16:49:32.378Z","trace_propagation_headers":{"sentry-trace":"3dc808433774479eb4f6f74ece1a7147-4c4f68adae034ef3","baggage":"sentry-trace_id=3dc808433774479eb4f6f74ece1a7147,sentry-release=Unknown"},"correlation_id":"01M05QJ87A61M882N27ZWSTC1E","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:32.386Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-560abeca37691df833b4b534: done: 0.055569 sec","job_status":"done","queue_duration_s":3.567697,"scheduling_latency_s":3.567717,"redis_calls":19,"redis_duration_s":0.0033410000000000002,"redis_read_bytes":21,"redis_write_bytes":4290,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000626,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000582,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2261,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001535,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000598,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036497,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00790164,"duration_s":0.055569,"completed_at":"2026-08-16T16:49:36.009Z","load_balancing_strategy":"primary","db_duration_s":0.012794,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2229gitlab # [ 417.572686] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:36.011Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","4c6c253f5dd5ff62a44d22c7"],"class":"WebHooks::LogExecutionWorker","jid":"0a88e3b054f2771fd94cd003","created_at":"2026-08-16T16:49:34.197Z","trace_propagation_headers":{"sentry-trace":"3dc808433774479eb4f6f74ece1a7147-0988675d4ae64180","baggage":"sentry-trace_id=3dc808433774479eb4f6f74ece1a7147,sentry-release=Unknown"},"correlation_id":"01M05QJ87A61M882N27ZWSTC1E","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0e20d640bc657e80ce9ad52e206381ebd2886ad76bbca3cb759adb08d0f69f4f","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:34.210Z","job_size_bytes":2593,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-0a88e3b054f2771fd94cd003: start","job_status":"start","queue_duration_s":1.800519,"scheduling_latency_s":1.800536}2230gitlab # [ 417.590674] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:49:36 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 4222231gitlab # [ 417.593520] gitaly[915]: time="2026-08-16T16:49:36.109Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=5 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QN36NF2S1Y0DMKVKY9TX3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T16:49:46.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:49:36.095" grpc.time_ms=13.986 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2232gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33'2233gitlab # [ 417.606807] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:36.055Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","4c6c253f5dd5ff62a44d22c7"],"class":"WebHooks::LogExecutionWorker","jid":"0a88e3b054f2771fd94cd003","created_at":"2026-08-16T16:49:34.197Z","trace_propagation_headers":{"sentry-trace":"3dc808433774479eb4f6f74ece1a7147-0988675d4ae64180","baggage":"sentry-trace_id=3dc808433774479eb4f6f74ece1a7147,sentry-release=Unknown"},"correlation_id":"01M05QJ87A61M882N27ZWSTC1E","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0e20d640bc657e80ce9ad52e206381ebd2886ad76bbca3cb759adb08d0f69f4f","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:34.210Z","job_size_bytes":2593,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-0a88e3b054f2771fd94cd003: done: 0.044446 sec","job_status":"done","queue_duration_s":1.800519,"scheduling_latency_s":1.800536,"redis_calls":10,"redis_duration_s":0.00185,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000399,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001103,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000348,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032688,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002452,"duration_s":0.044446,"completed_at":"2026-08-16T16:49:36.055Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006212,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2234gitlab # [ 417.650572] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:36.057Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"94d47188705d8ca4af98cbd9","created_at":"2026-08-16T16:49:34.876Z","trace_propagation_headers":{"sentry-trace":"703993ce4d0f4d549430fe5aa895e412-598f1e641885468f","baggage":"sentry-trace_id=703993ce4d0f4d549430fe5aa895e412,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QN1TP1CPQYH9VYE32SXKW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:34.883Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-94d47188705d8ca4af98cbd9: start","job_status":"start","queue_duration_s":1.173904,"scheduling_latency_s":1.173921}2235gitlab # [ 417.665474] nix-daemon[3693]: accepted connection from pid 4325, user nixbot2236gitlab # [ 417.666331] gitaly[915]: time="2026-08-16T16:49:36.156Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05QN36NF2S1Y0DMKVKY9TX3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-16T16:49:46.066" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:49:36.156" grpc.time_ms=0.285 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2237gitlab # [ 417.677456] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:36.406Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"94d47188705d8ca4af98cbd9","created_at":"2026-08-16T16:49:34.876Z","trace_propagation_headers":{"sentry-trace":"703993ce4d0f4d549430fe5aa895e412-598f1e641885468f","baggage":"sentry-trace_id=703993ce4d0f4d549430fe5aa895e412,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QN1TP1CPQYH9VYE32SXKW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:34.883Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3369,"job_status":"rescheduled","message":"PipelineProcessWorker JID-94d47188705d8ca4af98cbd9: rescheduled"}2238gitlab # [ 417.692549] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:36.414Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"94d47188705d8ca4af98cbd9","created_at":"2026-08-16T16:49:34.876Z","trace_propagation_headers":{"sentry-trace":"703993ce4d0f4d549430fe5aa895e412-598f1e641885468f","baggage":"sentry-trace_id=703993ce4d0f4d549430fe5aa895e412,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QN1TP1CPQYH9VYE32SXKW","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:34.883Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-94d47188705d8ca4af98cbd9: done: 0.357766 sec","job_status":"done","queue_duration_s":1.173904,"scheduling_latency_s":1.173921,"gitaly_calls":3,"gitaly_duration_s":0.148885,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.017401,"redis_read_bytes":150,"redis_write_bytes":18010,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000393,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000701,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.00501,"redis_queues_read_bytes":28,"redis_queues_write_bytes":12309,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.005147,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000198,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.003068,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002491,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.051,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.011,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.011,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.029,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.149763,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.31133914,"duration_s":0.357766,"completed_at":"2026-08-16T16:49:36.414Z","load_balancing_strategy":"primary","db_duration_s":0.055548,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2239gitlab # [ 417.743729] gitaly[915]: time="2026-08-16T16:49:36.171Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=6 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05QN36NF2S1Y0DMKVKY9TX3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-16T16:49:46.071" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:49:36.162" grpc.time_ms=9.003 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2240gitlab # [ 417.757170] gitaly[915]: time="2026-08-16T16:49:36.199Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QN1TP1CPQYH9VYE32SXKW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:49:36.198" grpc.time_ms=0.395 pid=915 span.kind=server system=grpc2241gitlab # [ 417.766747] nixbot[3479]: {"ts": "2026-08-16T16:49:36.581Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-82d436ddd9f2-4", "argv0": "bwrap"}2242gitlab # [ 417.769168] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:36.416Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","bbd95328a65d91488839f933"],"class":"WebHooks::LogExecutionWorker","jid":"bc710f73b17ce8df1e1067d0","created_at":"2026-08-16T16:49:35.302Z","trace_propagation_headers":{"sentry-trace":"d63357342b9d43fe9f686ac1be98fc6d-4fea356892064692","baggage":"sentry-trace_id=d63357342b9d43fe9f686ac1be98fc6d,sentry-release=Unknown"},"correlation_id":"01M05QJDGY15739NMS0VRRZ16G","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98b15920b0a0a3a6054f5da09082951d264d10c14d158e63f4d30afe1fd99a0b","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:35.307Z","job_size_bytes":2591,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-bc710f73b17ce8df1e1067d0: start","job_status":"start","queue_duration_s":1.109243,"scheduling_latency_s":1.109269}2243gitlab # [ 417.785698] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:36.446Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","bbd95328a65d91488839f933"],"class":"WebHooks::LogExecutionWorker","jid":"bc710f73b17ce8df1e1067d0","created_at":"2026-08-16T16:49:35.302Z","trace_propagation_headers":{"sentry-trace":"d63357342b9d43fe9f686ac1be98fc6d-4fea356892064692","baggage":"sentry-trace_id=d63357342b9d43fe9f686ac1be98fc6d,sentry-release=Unknown"},"correlation_id":"01M05QJDGY15739NMS0VRRZ16G","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98b15920b0a0a3a6054f5da09082951d264d10c14d158e63f4d30afe1fd99a0b","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:35.307Z","job_size_bytes":2591,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-bc710f73b17ce8df1e1067d0: done: 0.030009 sec","job_status":"done","queue_duration_s":1.109243,"scheduling_latency_s":1.109269,"redis_calls":7,"redis_duration_s":0.001506,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001129,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000377,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020699,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030009,"completed_at":"2026-08-16T16:49:36.446Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00354,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2244gitlab # [ 417.829991] nix-daemon[3693]: accepted connection from pid 4333, user nixbot2245gitlab # [ 417.831234] gitaly[915]: time="2026-08-16T16:49:36.220Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QN36NF2S1Y0DMKVKY9TX3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4153 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:49:36.217" grpc.time_ms=2.624 pid=915 span.kind=server system=grpc2246gitlab # [ 417.841063] gitaly[915]: time="2026-08-16T16:49:36.235Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QN1TP1CPQYH9VYE32SXKW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3895 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:49:36.233" grpc.time_ms=1.454 pid=915 span.kind=server system=grpc2247gitlab # [ 417.850346] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:36.448Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"feafcadcc133d2f3d17ec827","created_at":"2026-08-16T16:49:35.996Z","trace_propagation_headers":{"sentry-trace":"3dc808433774479eb4f6f74ece1a7147-440a3847edb742b0","baggage":"sentry-trace_id=3dc808433774479eb4f6f74ece1a7147,sentry-release=Unknown"},"correlation_id":"01M05QJ87A61M882N27ZWSTC1E","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:36.001Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-feafcadcc133d2f3d17ec827: start","job_status":"start","queue_duration_s":0.447147,"scheduling_latency_s":0.447176}2248gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', in 0.24 seconds)2249(finished: subtest: push delivers the webhook, in 88.83 seconds)2250subtest: eval and build post commit statuses2251gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33/statuses2252gitlab # [ 417.867465] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:36.551Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"feafcadcc133d2f3d17ec827","created_at":"2026-08-16T16:49:35.996Z","trace_propagation_headers":{"sentry-trace":"3dc808433774479eb4f6f74ece1a7147-440a3847edb742b0","baggage":"sentry-trace_id=3dc808433774479eb4f6f74ece1a7147,sentry-release=Unknown"},"correlation_id":"01M05QJ87A61M882N27ZWSTC1E","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:36.001Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-feafcadcc133d2f3d17ec827: done: 0.102892 sec","job_status":"done","queue_duration_s":0.447147,"scheduling_latency_s":0.447176,"redis_calls":11,"redis_duration_s":0.002499,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000565,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00141,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000524,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.078037,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026814,"duration_s":0.102892,"completed_at":"2026-08-16T16:49:36.551Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019495,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2253gitlab # [ 417.913613] gitaly[915]: time="2026-08-16T16:49:36.242Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QN36NF2S1Y0DMKVKY9TX3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:49:36.241" grpc.time_ms=0.342 pid=915 span.kind=server system=grpc2254gitlab # [ 417.923735] gitaly[915]: time="2026-08-16T16:49:36.252Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05QN36NF2S1Y0DMKVKY9TX3 diskcache=75540337-72e0-4052-a6b0-1f50ab86f29c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T16:49:46.083" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:49:36.174" pid=915 ref=refs/keep-around/82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 remote_ip="2001:db8:1::1" revision=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 span.kind=server system=grpc username=root2255gitlab # [ 417.935659] nixbot[3479]: INFO: ::ffff:127.0.0.1:38564 - "GET /api/repos/gitlab/root/test-flake/builds?commit=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 200 OK2256gitlab # [ 417.937747] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:36.552Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"9c8b2b711cdc963fb2ce1cd2","created_at":"2026-08-16T16:49:36.132Z","trace_propagation_headers":{"sentry-trace":"703993ce4d0f4d549430fe5aa895e412-73d9b62bda3546bc","baggage":"sentry-trace_id=703993ce4d0f4d549430fe5aa895e412,sentry-release=Unknown"},"correlation_id":"01M05QN1TP1CPQYH9VYE32SXKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:36.134Z","job_size_bytes":23,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-9c8b2b711cdc963fb2ce1cd2: start","job_status":"start","queue_duration_s":0.418046,"scheduling_latency_s":0.418065}2257gitlab # [ 417.954805] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:36.598Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"9c8b2b711cdc963fb2ce1cd2","created_at":"2026-08-16T16:49:36.132Z","trace_propagation_headers":{"sentry-trace":"703993ce4d0f4d549430fe5aa895e412-73d9b62bda3546bc","baggage":"sentry-trace_id=703993ce4d0f4d549430fe5aa895e412,sentry-release=Unknown"},"correlation_id":"01M05QN1TP1CPQYH9VYE32SXKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:36.134Z","job_size_bytes":23,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-9c8b2b711cdc963fb2ce1cd2: done: 0.046158 sec","job_status":"done","queue_duration_s":0.418046,"scheduling_latency_s":0.418065,"redis_calls":7,"redis_duration_s":0.0011610000000000001,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000827,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000334,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032807,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.046158,"completed_at":"2026-08-16T16:49:36.598Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009939,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2258gitlab # [ 417.999396] gitaly[915]: time="2026-08-16T16:49:36.252Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=65 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5193 command.oublock=8 command.real_time_ms=73 command.spawn_token_fork_ms=0 command.system_time_ms=35 command.user_time_ms=30 component=gitaly.UnaryServerInterceptor correlation_id=01M05QN36NF2S1Y0DMKVKY9TX3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T16:49:46.083" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T16:49:36.174" grpc.time_ms=77.869 pid=915 ref=refs/keep-around/82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 remote_ip="2001:db8:1::1" revision=82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 span.kind=server system=grpc username=root2259gitlab # [ 418.016168] nix-daemon[3693]: accepted connection from pid 4350, user nixbot2260gitlab # [ 418.017156] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:36.600Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"5beedcf1ba2498a9294d8d3e","created_at":"2026-08-16T16:49:36.263Z","trace_propagation_headers":{"sentry-trace":"abe9d6b89d674c6da8cfd0b9e062e239-3c73b3a3ad8a4d29","baggage":"sentry-trace_id=abe9d6b89d674c6da8cfd0b9e062e239,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QN36NF2S1Y0DMKVKY9TX3","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:36.268Z","job_size_bytes":65,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-5beedcf1ba2498a9294d8d3e: start","job_status":"start","queue_duration_s":0.331693,"scheduling_latency_s":0.331714}2261gitlab # [ 418.034174] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:36.630Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"5beedcf1ba2498a9294d8d3e","created_at":"2026-08-16T16:49:36.263Z","trace_propagation_headers":{"sentry-trace":"abe9d6b89d674c6da8cfd0b9e062e239-3c73b3a3ad8a4d29","baggage":"sentry-trace_id=abe9d6b89d674c6da8cfd0b9e062e239,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QN36NF2S1Y0DMKVKY9TX3","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:36.268Z","job_size_bytes":65,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-5beedcf1ba2498a9294d8d3e: done: 0.030693 sec","job_status":"done","queue_duration_s":0.331693,"scheduling_latency_s":0.331714,"redis_calls":7,"redis_duration_s":0.0010500000000000002,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000747,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000303,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021138,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030693,"completed_at":"2026-08-16T16:49:36.630Z","load_balancing_strategy":"primary","db_duration_s":0.005681,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2262gitlab # [ 418.078314] gitaly[915]: time="2026-08-16T16:49:36.255Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QN36NF2S1Y0DMKVKY9TX3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:50:06.254" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:49:36.255" grpc.time_ms=0.422 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2263gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33/statuses, in 0.23 seconds)2264gitlab # [ 418.094536] gitaly[915]: time="2026-08-16T16:49:36.274Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QN1TP1CPQYH9VYE32SXKW grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:49:36.273" grpc.time_ms=0.385 pid=915 span.kind=server system=grpc2265gitlab # [ 418.104252] nix-daemon[3693]: accepted connection from pid 4362, user nixbot2266gitlab # [ 418.105116] nix-daemon[3693]: accepted connection from pid 4350, user nixbot2267gitlab # [ 418.106243] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:36.632Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"7b4804469babbe19619a5dd5","created_at":"2026-08-16T16:49:36.269Z","trace_propagation_headers":{"sentry-trace":"abe9d6b89d674c6da8cfd0b9e062e239-3c73b3a3ad8a4d29","baggage":"sentry-trace_id=abe9d6b89d674c6da8cfd0b9e062e239,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QN36NF2S1Y0DMKVKY9TX3","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:36.273Z","job_size_bytes":65,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-7b4804469babbe19619a5dd5: start","job_status":"start","queue_duration_s":0.35905,"scheduling_latency_s":0.359072}2268gitlab # [ 418.124602] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:36.729Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"7b4804469babbe19619a5dd5","created_at":"2026-08-16T16:49:36.269Z","trace_propagation_headers":{"sentry-trace":"abe9d6b89d674c6da8cfd0b9e062e239-3c73b3a3ad8a4d29","baggage":"sentry-trace_id=abe9d6b89d674c6da8cfd0b9e062e239,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QN36NF2S1Y0DMKVKY9TX3","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:36.273Z","job_size_bytes":65,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-7b4804469babbe19619a5dd5: done: 0.096968 sec","job_status":"done","queue_duration_s":0.35905,"scheduling_latency_s":0.359072,"redis_calls":10,"redis_duration_s":0.0033499999999999997,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001937,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001413,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.074004,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.096968,"completed_at":"2026-08-16T16:49:36.729Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018233,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2269gitlab # [ 418.169517] gitaly[915]: time="2026-08-16T16:49:36.280Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05QN1TP1CPQYH9VYE32SXKW diskcache=038fc97d-2c08-4c7b-ad62-f90a2805b683 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T16:50:06.040" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:49:36.140" pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2270gitlab # [ 418.179764] gitaly[915]: time="2026-08-16T16:49:36.281Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=131 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7295 command.oublock=0 command.real_time_ms=136 command.spawn_token_fork_ms=0 command.system_time_ms=90 command.user_time_ms=41 component=gitaly.UnaryServerInterceptor correlation_id=01M05QN1TP1CPQYH9VYE32SXKW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T16:50:06.040" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:49:36.140" grpc.time_ms=140.092 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2271gitlab # [ 418.193954] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:49:36 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1412272gitlab # [ 418.196621] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:36.732Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"73f02a0f3ba4b8416268d868","created_at":"2026-08-16T16:49:36.286Z","trace_propagation_headers":{"sentry-trace":"703993ce4d0f4d549430fe5aa895e412-73d9b62bda3546bc","baggage":"sentry-trace_id=703993ce4d0f4d549430fe5aa895e412,sentry-release=Unknown"},"correlation_id":"01M05QN1TP1CPQYH9VYE32SXKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:36.288Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-73f02a0f3ba4b8416268d868: start","job_status":"start","queue_duration_s":0.443459,"scheduling_latency_s":0.443496}2273gitlab # [ 418.214610] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:36.812Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"73f02a0f3ba4b8416268d868","created_at":"2026-08-16T16:49:36.286Z","trace_propagation_headers":{"sentry-trace":"703993ce4d0f4d549430fe5aa895e412-73d9b62bda3546bc","baggage":"sentry-trace_id=703993ce4d0f4d549430fe5aa895e412,sentry-release=Unknown"},"correlation_id":"01M05QN1TP1CPQYH9VYE32SXKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:36.288Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-73f02a0f3ba4b8416268d868: done: 0.080664 sec","job_status":"done","queue_duration_s":0.443459,"scheduling_latency_s":0.443496,"redis_calls":7,"redis_duration_s":0.002833,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001928,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000905,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.017,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050826,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.080664,"completed_at":"2026-08-16T16:49:36.812Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016989,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2274gitlab # [ 418.258204] gitaly[915]: time="2026-08-16T16:49:36.354Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QN1TP1CPQYH9VYE32SXKW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T16:50:06.252" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:49:36.352" grpc.time_ms=1.107 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2275gitlab # [ 418.271346] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:36.816Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"17262cf3de8df8852dfc28e3","created_at":"2026-08-16T16:49:36.296Z","trace_propagation_headers":{"sentry-trace":"703993ce4d0f4d549430fe5aa895e412-73d9b62bda3546bc","baggage":"sentry-trace_id=703993ce4d0f4d549430fe5aa895e412,sentry-release=Unknown"},"correlation_id":"01M05QN1TP1CPQYH9VYE32SXKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:36.299Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-17262cf3de8df8852dfc28e3: start","job_status":"start","queue_duration_s":0.517103,"scheduling_latency_s":0.51714}2276gitlab # [ 418.287729] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:36.875Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"17262cf3de8df8852dfc28e3","created_at":"2026-08-16T16:49:36.296Z","trace_propagation_headers":{"sentry-trace":"703993ce4d0f4d549430fe5aa895e412-73d9b62bda3546bc","baggage":"sentry-trace_id=703993ce4d0f4d549430fe5aa895e412,sentry-release=Unknown"},"correlation_id":"01M05QN1TP1CPQYH9VYE32SXKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:36.299Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-17262cf3de8df8852dfc28e3: done: 0.059145 sec","job_status":"done","queue_duration_s":0.517103,"scheduling_latency_s":0.51714,"redis_calls":7,"redis_duration_s":0.00466,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003837,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000823,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038998,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.059145,"completed_at":"2026-08-16T16:49:36.875Z","load_balancing_strategy":"primary","db_duration_s":0.008441,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2277gitlab # [ 418.330476] gitaly[915]: time="2026-08-16T16:49:36.396Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QN1TP1CPQYH9VYE32SXKW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:50:06.295" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:49:36.396" grpc.time_ms=0.606 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2278gitlab # [ 418.343006] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:36.878Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"1888d1a800e9d83480f71a7e","created_at":"2026-08-16T16:49:36.312Z","trace_propagation_headers":{"sentry-trace":"703993ce4d0f4d549430fe5aa895e412-73d9b62bda3546bc","baggage":"sentry-trace_id=703993ce4d0f4d549430fe5aa895e412,sentry-release=Unknown"},"correlation_id":"01M05QN1TP1CPQYH9VYE32SXKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:36.315Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-1888d1a800e9d83480f71a7e: start","job_status":"start","queue_duration_s":0.563191,"scheduling_latency_s":0.563218}2279gitlab # [ 418.358760] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:36.926Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"1888d1a800e9d83480f71a7e","created_at":"2026-08-16T16:49:36.312Z","trace_propagation_headers":{"sentry-trace":"703993ce4d0f4d549430fe5aa895e412-73d9b62bda3546bc","baggage":"sentry-trace_id=703993ce4d0f4d549430fe5aa895e412,sentry-release=Unknown"},"correlation_id":"01M05QN1TP1CPQYH9VYE32SXKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:36.315Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-1888d1a800e9d83480f71a7e: done: 0.04861 sec","job_status":"done","queue_duration_s":0.563191,"scheduling_latency_s":0.563218,"redis_calls":10,"redis_duration_s":0.002586,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000987,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001206,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000393,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032083,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.04861,"completed_at":"2026-08-16T16:49:36.926Z","load_balancing_strategy":"primary","db_duration_s":0.009531,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2280gitlab # [ 418.402043] gitaly[915]: time="2026-08-16T16:49:36.935Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QN4267CC6NN1A6BY54KWD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:50:06.733" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:49:36.934" grpc.time_ms=0.906 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2281gitlab # [ 418.415824] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:36.928Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"0b1e4bbd2db25bddb5bfd62c","created_at":"2026-08-16T16:49:36.315Z","trace_propagation_headers":{"sentry-trace":"703993ce4d0f4d549430fe5aa895e412-73d9b62bda3546bc","baggage":"sentry-trace_id=703993ce4d0f4d549430fe5aa895e412,sentry-release=Unknown"},"correlation_id":"01M05QN1TP1CPQYH9VYE32SXKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:36.317Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-0b1e4bbd2db25bddb5bfd62c: start","job_status":"start","queue_duration_s":0.611049,"scheduling_latency_s":0.611074}2282gitlab # [ 418.433069] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:36.974Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"0b1e4bbd2db25bddb5bfd62c","created_at":"2026-08-16T16:49:36.315Z","trace_propagation_headers":{"sentry-trace":"703993ce4d0f4d549430fe5aa895e412-73d9b62bda3546bc","baggage":"sentry-trace_id=703993ce4d0f4d549430fe5aa895e412,sentry-release=Unknown"},"correlation_id":"01M05QN1TP1CPQYH9VYE32SXKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:36.317Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-0b1e4bbd2db25bddb5bfd62c: done: 0.045587 sec","job_status":"done","queue_duration_s":0.611049,"scheduling_latency_s":0.611074,"redis_calls":7,"redis_duration_s":0.010761,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.010433,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000328,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02173,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.045587,"completed_at":"2026-08-16T16:49:36.973Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009513,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2283gitlab # [ 418.476966] gitaly[915]: time="2026-08-16T16:49:37.199Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QN36NF2S1Y0DMKVKY9TX3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T16:50:07.097" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:49:37.197" grpc.time_ms=1.261 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2284gitlab # [ 418.490098] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:36.975Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"d413d4922ac01c6c390bcd3a","created_at":"2026-08-16T16:49:36.318Z","trace_propagation_headers":{"sentry-trace":"703993ce4d0f4d549430fe5aa895e412-73d9b62bda3546bc","baggage":"sentry-trace_id=703993ce4d0f4d549430fe5aa895e412,sentry-release=Unknown"},"correlation_id":"01M05QN1TP1CPQYH9VYE32SXKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:36.323Z","job_size_bytes":19,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-d413d4922ac01c6c390bcd3a: start","job_status":"start","queue_duration_s":0.65197,"scheduling_latency_s":0.651994}2285gitlab # [ 418.506655] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:37.009Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"d413d4922ac01c6c390bcd3a","created_at":"2026-08-16T16:49:36.318Z","trace_propagation_headers":{"sentry-trace":"703993ce4d0f4d549430fe5aa895e412-73d9b62bda3546bc","baggage":"sentry-trace_id=703993ce4d0f4d549430fe5aa895e412,sentry-release=Unknown"},"correlation_id":"01M05QN1TP1CPQYH9VYE32SXKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:36.323Z","job_size_bytes":19,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-d413d4922ac01c6c390bcd3a: done: 0.033381 sec","job_status":"done","queue_duration_s":0.65197,"scheduling_latency_s":0.651994,"redis_calls":8,"redis_duration_s":0.004216,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003128,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001088,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021883,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033381,"completed_at":"2026-08-16T16:49:37.008Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00407,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2286gitlab # [ 418.551161] gitaly[915]: time="2026-08-16T16:49:37.245Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QN36NF2S1Y0DMKVKY9TX3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:50:07.143" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:49:37.244" grpc.time_ms=1.041 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2287gitlab # [ 418.588787] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:37.010Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"857cbcf6729a984586e8c7d7","created_at":"2026-08-16T16:49:36.325Z","trace_propagation_headers":{"sentry-trace":"703993ce4d0f4d549430fe5aa895e412-73d9b62bda3546bc","baggage":"sentry-trace_id=703993ce4d0f4d549430fe5aa895e412,sentry-release=Unknown"},"correlation_id":"01M05QN1TP1CPQYH9VYE32SXKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:36.328Z","job_size_bytes":66,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-857cbcf6729a984586e8c7d7: start","job_status":"start","queue_duration_s":0.681687,"scheduling_latency_s":0.681712}2288gitlab # [ 418.630592] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:37.037Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"857cbcf6729a984586e8c7d7","created_at":"2026-08-16T16:49:36.325Z","trace_propagation_headers":{"sentry-trace":"703993ce4d0f4d549430fe5aa895e412-73d9b62bda3546bc","baggage":"sentry-trace_id=703993ce4d0f4d549430fe5aa895e412,sentry-release=Unknown"},"correlation_id":"01M05QN1TP1CPQYH9VYE32SXKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:36.328Z","job_size_bytes":66,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-857cbcf6729a984586e8c7d7: done: 0.026801 sec","job_status":"done","queue_duration_s":0.681687,"scheduling_latency_s":0.681712,"redis_calls":7,"redis_duration_s":0.001523,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001147,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000376,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019108,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026801,"completed_at":"2026-08-16T16:49:37.037Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002576,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2289gitlab # [ 418.699662] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:37.038Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"aee814ade4d48110022614a2","created_at":"2026-08-16T16:49:36.329Z","trace_propagation_headers":{"sentry-trace":"703993ce4d0f4d549430fe5aa895e412-73d9b62bda3546bc","baggage":"sentry-trace_id=703993ce4d0f4d549430fe5aa895e412,sentry-release=Unknown"},"correlation_id":"01M05QN1TP1CPQYH9VYE32SXKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:36.333Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-aee814ade4d48110022614a2: start","job_status":"start","queue_duration_s":0.705865,"scheduling_latency_s":0.705888}2290gitlab # [ 418.717968] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:37.068Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"aee814ade4d48110022614a2","created_at":"2026-08-16T16:49:36.329Z","trace_propagation_headers":{"sentry-trace":"703993ce4d0f4d549430fe5aa895e412-73d9b62bda3546bc","baggage":"sentry-trace_id=703993ce4d0f4d549430fe5aa895e412,sentry-release=Unknown"},"correlation_id":"01M05QN1TP1CPQYH9VYE32SXKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:36.333Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-aee814ade4d48110022614a2: done: 0.030051 sec","job_status":"done","queue_duration_s":0.705865,"scheduling_latency_s":0.705888,"redis_calls":7,"redis_duration_s":0.002239,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001707,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000532,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018078,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030051,"completed_at":"2026-08-16T16:49:37.068Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006614,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2291gitlab # [ 418.760438] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:37.070Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"29a8d1751661a556b60cd536","created_at":"2026-08-16T16:49:36.333Z","trace_propagation_headers":{"sentry-trace":"703993ce4d0f4d549430fe5aa895e412-73d9b62bda3546bc","baggage":"sentry-trace_id=703993ce4d0f4d549430fe5aa895e412,sentry-release=Unknown"},"correlation_id":"01M05QN1TP1CPQYH9VYE32SXKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:36.336Z","job_size_bytes":6,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-29a8d1751661a556b60cd536: start","job_status":"start","queue_duration_s":0.734254,"scheduling_latency_s":0.734281}2292gitlab # [ 418.776726] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:37.086Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"29a8d1751661a556b60cd536","created_at":"2026-08-16T16:49:36.333Z","trace_propagation_headers":{"sentry-trace":"703993ce4d0f4d549430fe5aa895e412-73d9b62bda3546bc","baggage":"sentry-trace_id=703993ce4d0f4d549430fe5aa895e412,sentry-release=Unknown"},"correlation_id":"01M05QN1TP1CPQYH9VYE32SXKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:36.336Z","job_size_bytes":6,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-29a8d1751661a556b60cd536: done: 0.016098 sec","job_status":"done","queue_duration_s":0.734254,"scheduling_latency_s":0.734281,"redis_calls":7,"redis_duration_s":0.0019290000000000002,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001435,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000494,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009545,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016098,"completed_at":"2026-08-16T16:49:37.086Z","load_balancing_strategy":"primary","db_duration_s":0.000651,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2293gitlab # [ 418.820374] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:37.088Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"5f84e0e8aba18f54f84fd603","created_at":"2026-08-16T16:49:36.337Z","trace_propagation_headers":{"sentry-trace":"703993ce4d0f4d549430fe5aa895e412-73d9b62bda3546bc","baggage":"sentry-trace_id=703993ce4d0f4d549430fe5aa895e412,sentry-release=Unknown"},"correlation_id":"01M05QN1TP1CPQYH9VYE32SXKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:36.340Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-5f84e0e8aba18f54f84fd603: start","job_status":"start","queue_duration_s":0.748243,"scheduling_latency_s":0.748259}2294gitlab # [ 418.835775] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:37.115Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"5f84e0e8aba18f54f84fd603","created_at":"2026-08-16T16:49:36.337Z","trace_propagation_headers":{"sentry-trace":"703993ce4d0f4d549430fe5aa895e412-73d9b62bda3546bc","baggage":"sentry-trace_id=703993ce4d0f4d549430fe5aa895e412,sentry-release=Unknown"},"correlation_id":"01M05QN1TP1CPQYH9VYE32SXKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:36.340Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-5f84e0e8aba18f54f84fd603: done: 0.026654 sec","job_status":"done","queue_duration_s":0.748243,"scheduling_latency_s":0.748259,"redis_calls":7,"redis_duration_s":0.00181,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001307,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000503,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016629,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026654,"completed_at":"2026-08-16T16:49:37.115Z","load_balancing_strategy":"primary","db_duration_s":0.005456,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2295gitlab # [ 418.879402] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:37.116Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"2ae23416aa15f11dfb1a1b8f","created_at":"2026-08-16T16:49:36.359Z","trace_propagation_headers":{"sentry-trace":"abe9d6b89d674c6da8cfd0b9e062e239-3c73b3a3ad8a4d29","baggage":"sentry-trace_id=abe9d6b89d674c6da8cfd0b9e062e239,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QN36NF2S1Y0DMKVKY9TX3","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:36.363Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2ae23416aa15f11dfb1a1b8f: start","job_status":"start","queue_duration_s":0.753227,"scheduling_latency_s":0.753245}2296gitlab # [ 418.927293] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:37.258Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"2ae23416aa15f11dfb1a1b8f","created_at":"2026-08-16T16:49:36.359Z","trace_propagation_headers":{"sentry-trace":"abe9d6b89d674c6da8cfd0b9e062e239-3c73b3a3ad8a4d29","baggage":"sentry-trace_id=abe9d6b89d674c6da8cfd0b9e062e239,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QN36NF2S1Y0DMKVKY9TX3","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:36.363Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-2ae23416aa15f11dfb1a1b8f: done: 0.141721 sec","job_status":"done","queue_duration_s":0.753227,"scheduling_latency_s":0.753245,"gitaly_calls":2,"gitaly_duration_s":0.00771,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.008653,"redis_read_bytes":79,"redis_write_bytes":5119,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001362,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001231,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000314,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1130,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00184,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000389,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000998,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001157,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.038,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.016,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.09274,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.10816236,"duration_s":0.141721,"completed_at":"2026-08-16T16:49:37.258Z","load_balancing_strategy":"primary","db_duration_s":0.041026,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2297gitlab # [ 419.006585] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:37.259Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"e0b6a0325b75a30869751290","created_at":"2026-08-16T16:49:36.407Z","trace_propagation_headers":{"sentry-trace":"703993ce4d0f4d549430fe5aa895e412-73d9b62bda3546bc","baggage":"sentry-trace_id=703993ce4d0f4d549430fe5aa895e412,sentry-release=Unknown"},"correlation_id":"01M05QN1TP1CPQYH9VYE32SXKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:36.409Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e0b6a0325b75a30869751290: start","job_status":"start","queue_duration_s":0.850435,"scheduling_latency_s":0.850452}2298gitlab # [ 419.022611] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:37.288Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"e0b6a0325b75a30869751290","created_at":"2026-08-16T16:49:36.407Z","trace_propagation_headers":{"sentry-trace":"703993ce4d0f4d549430fe5aa895e412-73d9b62bda3546bc","baggage":"sentry-trace_id=703993ce4d0f4d549430fe5aa895e412,sentry-release=Unknown"},"correlation_id":"01M05QN1TP1CPQYH9VYE32SXKW","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:36.409Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e0b6a0325b75a30869751290: done: 0.029295 sec","job_status":"done","queue_duration_s":0.850435,"scheduling_latency_s":0.850452,"redis_calls":8,"redis_duration_s":0.002258,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001653,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000605,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018517,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029295,"completed_at":"2026-08-16T16:49:37.288Z","load_balancing_strategy":"primary","db_duration_s":0.006441,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2299gitlab # [ 419.065709] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:37.290Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"77cea3be969039d0cfe17741","created_at":"2026-08-16T16:49:37.179Z","trace_propagation_headers":{"sentry-trace":"abe9d6b89d674c6da8cfd0b9e062e239-0451db9942f84250","baggage":"sentry-trace_id=abe9d6b89d674c6da8cfd0b9e062e239,sentry-release=Unknown"},"correlation_id":"01M05QN36NF2S1Y0DMKVKY9TX3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:37.182Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-77cea3be969039d0cfe17741: start","job_status":"start","queue_duration_s":0.108465,"scheduling_latency_s":0.108482}2300gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33/statuses2301gitlab # [ 419.081628] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:37.448Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"77cea3be969039d0cfe17741","created_at":"2026-08-16T16:49:37.179Z","trace_propagation_headers":{"sentry-trace":"abe9d6b89d674c6da8cfd0b9e062e239-0451db9942f84250","baggage":"sentry-trace_id=abe9d6b89d674c6da8cfd0b9e062e239,sentry-release=Unknown"},"correlation_id":"01M05QN36NF2S1Y0DMKVKY9TX3","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:37.182Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-77cea3be969039d0cfe17741: done: 0.158168 sec","job_status":"done","queue_duration_s":0.108465,"scheduling_latency_s":0.108482,"redis_calls":7,"redis_duration_s":0.001779,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001287,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000492,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.146757,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.158168,"completed_at":"2026-08-16T16:49:37.448Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007274,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2302gitlab # [ 419.289335] gitaly[915]: time="2026-08-16T16:49:38.174Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QN58THN03KAZKNM0KZ9ZZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:50:08.171" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:49:38.172" grpc.time_ms=1.271 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2303gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33/statuses, in 0.26 seconds)2304gitlab # [ 419.362467] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:49:38 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1712305gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33/statuses2306gitlab # [ 420.509550] gitaly[915]: time="2026-08-16T16:49:39.393Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QN6F63KQG507103R4FX6A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:50:09.391" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:49:39.391" grpc.time_ms=1.588 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2307gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33/statuses, in 0.19 seconds)2308gitlab # [ 420.554285] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:49:39 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1362309gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33/statuses2310gitlab # [ 421.708869] gitaly[915]: time="2026-08-16T16:49:40.593Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QN7MES5CM9YQWWK5WGHC3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:50:10.190" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:49:40.591" grpc.time_ms=1.301 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2311gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33/statuses, in 0.20 seconds)2312gitlab # [ 421.756773] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:49:40 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1462313gitlab # [ 422.716429] gitaly[915]: time="2026-08-16T16:49:41.600Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QN8K3W945GYGEGE04NZP8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:50:11.598" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:49:41.599" grpc.time_ms=1.27 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2314gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33/statuses2315gitlab # [ 422.815774] gitaly[915]: time="2026-08-16T16:49:41.701Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=3 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QN8K3W945GYGEGE04NZP8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T16:49:51.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:49:41.682" grpc.time_ms=18.088 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2316gitlab # [ 422.902053] gitaly[915]: time="2026-08-16T16:49:41.787Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QN8T0C7H8NSD3KQEK3XP7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:50:11.385" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:49:41.786" grpc.time_ms=1.116 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2317gitlab # [ 422.928395] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:41.788Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"0f59eaa999806ded88c27efa","created_at":"2026-08-16T16:49:41.777Z","trace_propagation_headers":{"sentry-trace":"efb011e24ba641c5a5ff3722f95419f9-6dbc642b2cfe477a","baggage":"sentry-trace_id=efb011e24ba641c5a5ff3722f95419f9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QN8K3W945GYGEGE04NZP8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:41.784Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-0f59eaa999806ded88c27efa: start","job_status":"start","queue_duration_s":0.003326,"scheduling_latency_s":0.003391}2318gitlab # [ 422.956648] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:49:41 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33/statuses HTTP/1.1" 200 671 "" "curl/8.21.0" 1442319gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33/statuses, in 0.20 seconds)2320gitlab # [ 422.960869] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:49:41 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 3692321gitlab # [ 422.964851] nixbot[3479]: {"ts": "2026-08-16T16:49:41.848Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 \"HTTP/1.1 201 Created\""}2322gitlab # [ 423.083291] gitaly[915]: time="2026-08-16T16:49:41.968Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QN8Z1M2MGSJH07D3HFAXR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:50:11.766" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:49:41.967" grpc.time_ms=1.114 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2323gitlab # [ 423.178621] gitaly[915]: time="2026-08-16T16:49:42.063Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QN8Z1M2MGSJH07D3HFAXR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T16:49:52.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:49:42.051" grpc.time_ms=12.284 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2324gitlab # [ 423.289219] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:49:42 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 3162325gitlab # [ 423.297406] nixbot[3479]: {"ts": "2026-08-16T16:49:42.175Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 \"HTTP/1.1 201 Created\""}2326gitlab # [ 423.426364] gitaly[915]: time="2026-08-16T16:49:42.311Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QN99H26NSB5WM6YQ83ZZM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:50:12.308" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:49:42.309" grpc.time_ms=1.659 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2327gitlab # [ 423.549012] gitaly[915]: time="2026-08-16T16:49:42.434Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QN99H26NSB5WM6YQ83ZZM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T16:49:52.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:49:42.413" grpc.time_ms=19.978 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2328gitlab # [ 423.579969] gitaly[915]: time="2026-08-16T16:49:42.452Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QN8K3W945GYGEGE04NZP8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:49:42.451" grpc.time_ms=0.934 pid=915 span.kind=server system=grpc2329gitlab # [ 423.625570] gitaly[915]: time="2026-08-16T16:49:42.510Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QN8K3W945GYGEGE04NZP8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3895 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:49:42.510" grpc.time_ms=0.535 pid=915 span.kind=server system=grpc2330gitlab # [ 423.653045] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:49:42 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 3452331gitlab # [ 423.656545] nixbot[3479]: {"ts": "2026-08-16T16:49:42.539Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33 \"HTTP/1.1 201 Created\""}2332gitlab # [ 423.687987] gitaly[915]: time="2026-08-16T16:49:42.573Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05QN8K3W945GYGEGE04NZP8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T16:49:42.572" grpc.time_ms=0.521 pid=915 span.kind=server system=grpc2333gitlab # [ 423.705453] gitaly[915]: time="2026-08-16T16:49:42.590Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M05QN8K3W945GYGEGE04NZP8 forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T16:50:12.298" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:49:42.398" operations="[repack_refs]" pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2334gitlab # [ 423.719538] gitaly[915]: time="2026-08-16T16:49:42.604Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M05QN8K3W945GYGEGE04NZP8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T16:50:12.298" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:49:42.398" pid=915 remote_ip="2001:db8:1::1" repository_info="{false {6 703 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-08-16 16:47:59.44813666 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root2335gitlab # [ 423.734947] gitaly[915]: time="2026-08-16T16:49:42.620Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05QN8K3W945GYGEGE04NZP8 diskcache=5d879982-bfb1-47ee-82a2-0582c5436621 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T16:50:12.298" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:49:42.398" pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2336gitlab # [ 423.746655] gitaly[915]: time="2026-08-16T16:49:42.631Z" level=info msg="finished unary call with code OK" command.count=4 command.cpu_time_ms=162 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7871 command.oublock=0 command.real_time_ms=207 command.spawn_token_fork_ms=3 command.system_time_ms=97 command.user_time_ms=65 component=gitaly.UnaryServerInterceptor correlation_id=01M05QN8K3W945GYGEGE04NZP8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T16:50:12.298" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:49:42.398" grpc.time_ms=232.984 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2337gitlab # [ 423.761679] gitaly[915]: time="2026-08-16T16:49:42.632Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M05QN8K3W945GYGEGE04NZP8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T16:50:12.298" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:49:42.398" pid=915 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root2338gitlab # [ 423.775147] gitaly[915]: time="2026-08-16T16:49:42.633Z" level=info msg="optimized repository" clean_stale_data_time=28.23574ms clean_work_trees_time="143.78µs" commit_graph_time=940ns correlation_id=01M05QN8K3W945GYGEGE04NZP8 gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="1.62µs" pid=915 prune_time=240ns relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="1.74µs" storage_name=default system=housekeeping total_time=28.41446ms2339gitlab # [ 423.781265] gitaly[915]: time="2026-08-16T16:49:42.633Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M05QN8K3W945GYGEGE04NZP8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T16:50:12.298" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T16:49:42.398" pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2340gitlab # [ 423.791682] nix-daemon[3693]: accepted connection from pid 4439, user nixbot2341gitlab # [ 423.893322] gitaly[915]: time="2026-08-16T16:49:42.778Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05QN8K3W945GYGEGE04NZP8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T16:50:12.677" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:49:42.777" grpc.time_ms=1.162 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2342gitlab # [ 423.924820] gitaly[915]: time="2026-08-16T16:49:42.810Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=577 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01M05QN9STFVKSF2DT82CVTFXH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:49:42.794" grpc.time_ms=15.764 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc2343gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33/statuses2344gitlab # [ 423.949350] gitaly[915]: time="2026-08-16T16:49:42.830Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QN8K3W945GYGEGE04NZP8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T16:50:12.728" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T16:49:42.829" grpc.time_ms=0.993 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2345gitlab # [ 423.969403] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:49:42 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 952346gitlab # [ 423.972912] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:42.851Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"1cce6dde99d6048a8c1d049c","created_at":"2026-08-16T16:49:42.847Z","trace_propagation_headers":{"sentry-trace":"efb011e24ba641c5a5ff3722f95419f9-eb55ea4b50d44c19","baggage":"sentry-trace_id=efb011e24ba641c5a5ff3722f95419f9,sentry-release=Unknown"},"correlation_id":"01M05QN8K3W945GYGEGE04NZP8","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"0f59eaa999806ded88c27efa","job_size_bytes":3,"pid":3369,"job_status":"deduplicated","message":"PipelineProcessWorker JID-1cce6dde99d6048a8c1d049c: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2347gitlab # [ 423.998026] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:42.854Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"0f59eaa999806ded88c27efa","created_at":"2026-08-16T16:49:41.777Z","trace_propagation_headers":{"sentry-trace":"efb011e24ba641c5a5ff3722f95419f9-6dbc642b2cfe477a","baggage":"sentry-trace_id=efb011e24ba641c5a5ff3722f95419f9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QN8K3W945GYGEGE04NZP8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:41.784Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3369,"job_status":"rescheduled","message":"PipelineProcessWorker JID-0f59eaa999806ded88c27efa: rescheduled"}2348gitlab # [ 424.015284] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:42.867Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"0f59eaa999806ded88c27efa","created_at":"2026-08-16T16:49:41.777Z","trace_propagation_headers":{"sentry-trace":"efb011e24ba641c5a5ff3722f95419f9-6dbc642b2cfe477a","baggage":"sentry-trace_id=efb011e24ba641c5a5ff3722f95419f9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05QN8K3W945GYGEGE04NZP8","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:41.784Z","job_size_bytes":3,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-0f59eaa999806ded88c27efa: done: 1.079783 sec","job_status":"done","queue_duration_s":0.003326,"scheduling_latency_s":0.003391,"gitaly_calls":3,"gitaly_duration_s":0.246064,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.074035,"redis_read_bytes":247,"redis_write_bytes":21780,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.018974,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.002154,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.010565,"redis_queues_read_bytes":36,"redis_queues_write_bytes":14465,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.009562,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.001144,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.003441,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.009221,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.295,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.038,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.057,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.199,"db_ci_duration_s":0.097,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.338209,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.772796,"duration_s":1.079783,"completed_at":"2026-08-16T16:49:42.867Z","load_balancing_strategy":"primary","db_duration_s":0.406465,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2349gitlab # [ 424.067890] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:42.870Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"999a2a757981259f4f9ab7d0","created_at":"2026-08-16T16:49:41.914Z","trace_propagation_headers":{"sentry-trace":"310697344f3e4c389d1111ca80f2ec68-4b5f3016f8d64bae","baggage":"sentry-trace_id=310697344f3e4c389d1111ca80f2ec68,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"098cb11da210dd27f4dd60498c6091a4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:41.986Z","job_size_bytes":2,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-999a2a757981259f4f9ab7d0: start","job_status":"start","queue_duration_s":0.88348,"scheduling_latency_s":0.88351}2350gitlab # [ 424.082882] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:42.890Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}2351gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33/statuses, in 0.17 seconds)2352gitlab # [ 424.086369] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:42.904Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"999a2a757981259f4f9ab7d0","created_at":"2026-08-16T16:49:41.914Z","trace_propagation_headers":{"sentry-trace":"310697344f3e4c389d1111ca80f2ec68-4b5f3016f8d64bae","baggage":"sentry-trace_id=310697344f3e4c389d1111ca80f2ec68,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"098cb11da210dd27f4dd60498c6091a4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:41.986Z","job_size_bytes":2,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-999a2a757981259f4f9ab7d0: done: 0.033777 sec","job_status":"done","queue_duration_s":0.88348,"scheduling_latency_s":0.88351,"redis_calls":9,"redis_duration_s":0.002934,"redis_read_bytes":7,"redis_write_bytes":1185,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000515,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001983,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000436,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019705,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033777,"completed_at":"2026-08-16T16:49:42.904Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001344,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2353(finished: subtest: eval and build post commit statuses, in 6.25 seconds)2354(finished: run the VM test script, in 496.98 seconds)2355gitlab # [ 424.129277] sidekiq-cluster[3369]: {"severity":"INFO","time":"2026-08-16T16:49:42.906Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"30ec780d1d7da8b305914eb4","created_at":"2026-08-16T16:49:42.043Z","trace_propagation_headers":{"sentry-trace":"310697344f3e4c389d1111ca80f2ec68-4b5f3016f8d64bae","baggage":"sentry-trace_id=310697344f3e4c389d1111ca80f2ec68,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"df1ca2cafae49a701562ffcd453cffb3","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-16T16:49:42.092Z","job_size_bytes":2,"pid":3369,"sidekiq_tid":"m8np","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-30ec780d1d7da8b305914eb4: start","job_status":"start","queue_duration_s":0.813533,"scheduling_latency_s":0.813556}2356gitlab # [ 424.142772] gitlab-workhorse[822]: time="2026-08-16T16:49:42Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672357gitlab # [ 424.144807] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:49:42 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1012358gitlab # [ 424.149588] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/16:16:49:43 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33/statuses HTTP/1.1" 200 1328 "" "curl/8.21.0" 1082359gitlab # [ 424.152967] gitaly[915]: time="2026-08-16T16:49:42.912Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05QN9WW1JATZNJ72BQDEPQB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:49:42.894" pid=915 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2360gitlab # [ 424.164594] nix-daemon[3693]: accepted connection from pid 4475, user nixbot2361gitlab # [ 424.166018] gitaly[915]: time="2026-08-16T16:49:42.912Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05QN9WW1JATZNJ72BQDEPQB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T16:49:42.894" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=915 remote_ip="2001:db8:1::1" span.kind=server system=grpc2362test script finished in 497.03s2363cleanup2364kill QemuMachine (pid 46)2365gitlab # [ 424.180508] gitaly[915]: time="2026-08-16T16:49:42.916Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlqemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/41m77i1296n33p6liin8ynr6wh3h6b7m-python3-3.14.6/bin/python3.14)2366gitlab # a2367(finished: cleanup, in 1.32 seconds)2368additionally exposed symbols:2369 gitlab,2370 vlan1,2371 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2372[]2373[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-08-16T16:48:07.545Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2374[]2375[]2376[]2377[]2378[]2379[]2380[]2381[]2382[]2383[]2384[]2385[]2386[]2387[]2388[]2389[]2390[]2391[]2392[]2393[]2394[]2395[]2396[]2397[]2398[]2399[]2400[]2401[]2402[]2403[]2404[]2405[]2406[]2407[]2408[]2409[]2410[]2411[]2412[]2413[]2414[]2415[]2416[]2417[]2418[]2419[]2420[]2421[]2422[]2423[]2424[]2425[]2426[]2427[]2428[]2429[]2430[]2431[]2432[]2433[]2434[]2435[]2436[]2437[]2438[]2439[]2440[]2441[]2442[]2443[]2444[]2445[]2446[]2447[]2448[]2449[]2450[]2451[]2452[]2453[]2454[]2455[]2456[]2457[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-08-16T16:49:35.947710Z', 'started_at': '2026-08-16T16:49:36.383923Z', 'finished_at': None}]2458[{'id': 5, 'sha': '82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-16T16:49:36.348Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2459[{'id': 5, 'sha': '82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-16T16:49:36.348Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2460[{'id': 5, 'sha': '82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-16T16:49:36.348Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2461[{'id': 5, 'sha': '82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-16T16:49:36.348Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2462[{'id': 5, 'sha': '82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-08-16T16:49:36.348Z', 'started_at': None, 'finished_at': '2026-08-16T16:49:41.757Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2463[{'id': 5, 'sha': '82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-08-16T16:49:36.348Z', 'started_at': None, 'finished_at': '2026-08-16T16:49:41.757Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '82d436ddd9f2cc857c3cb92eea3ecc6a89f83b33', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '0 attributes built', 'created_at': '2026-08-16T16:49:42.122Z', 'started_at': None, 'finished_at': '2026-08-16T16:49:42.487Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]