nixbot

builds

succeeded vm-test-run-nixbot-gitlab checks.aarch64-linux.nixbot-gitlab · build #299 · raw

1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab # Disk image does not exist, creating the virtualisation disk image...10gitlab: QEMU running (pid 46)11gitlab # Formatting '/build/vm-state-gitlab/tmp.NLPoUNbuXt', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13gitlab # Discarding device blocks: 0/262144 done14gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes15(finished: start all VMs, in 73.12 seconds)16gitlab # Filesystem UUID: 16294c7f-afc8-4a9b-99f8-05be6d990efb17gitlab: waiting for unit setup-gitlab.service18gitlab # Superblock backups stored on blocks:19gitlab: waiting for the VM to finish booting20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]31gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Thu Aug 6 17:27:09 UTC 202632gitlab # [ 0.000000] KASLR enabled33gitlab # [ 0.000000] random: crng init done34gitlab # [ 0.000000] Machine model: linux,dummy-virt35gitlab # [ 0.000000] efi: UEFI not found.36gitlab # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT37gitlab # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff]38gitlab # [ 0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf]39gitlab # [ 0.000000] Zone ranges:40gitlab # [ 0.000000] DMA [mem 0x0000000040000000-0x00000000ffffffff]41gitlab # [ 0.000000] DMA32 empty42gitlab # [ 0.000000] Normal [mem 0x0000000100000000-0x00000001bfffffff]43gitlab # [ 0.000000] Device empty44gitlab # [ 0.000000] Movable zone start for each node45gitlab # [ 0.000000] Early memory node ranges46gitlab # [ 0.000000] node 0: [mem 0x0000000040000000-0x00000001bfffffff]47gitlab # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff]48gitlab # [ 0.000000] cma: Reserved 32 MiB at 0x00000000fe00000049gitlab # [ 0.000000] psci: probing for conduit method from DT.50gitlab # [ 0.000000] psci: PSCIv1.3 detected in firmware.51gitlab # [ 0.000000] psci: Using standard PSCI v0.2 function IDs52gitlab # [ 0.000000] psci: Trusted OS migration not required53gitlab # [ 0.000000] psci: SMC Calling Convention v1.154gitlab # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)55gitlab # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u31129656gitlab # [ 0.000000] Detected PIPT I-cache on CPU057gitlab # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)58gitlab # [ 0.000000] CPU features: detected: GICv3 CPU interface59gitlab # [ 0.000000] CPU features: detected: Spectre-v460gitlab # [ 0.000000] CPU features: detected: Spectre-BHB61gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_3862gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_2363gitlab # [ 0.000000] alternatives: applying boot alternatives64gitlab # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/zrvzfj07rms8rpynnvxgg02kbcah0jql-nixos-system-gitlab-test/init regInfo=/nix/store/n1xpz0rfz9z8gnz24hhf8w89fcmbqs6l-closure-info/registration console=ttyAMA0,115200n8 console=tty065gitlab # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/n1xpz0rfz9z8gnz24hhf8w89fcmbqs6l-closure-info/registration", will be passed to user space.66gitlab # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes67gitlab # [ 0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)68gitlab # [ 0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)69gitlab # [ 0.000000] software IO TLB: area num 4.70gitlab # [ 0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB)71gitlab # [ 0.000000] Fallback order for Node 0: 072gitlab # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 157286473gitlab # [ 0.000000] Policy zone: Normal74gitlab # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off75gitlab # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=176gitlab # [ 0.000000] allocated 12582912 bytes of page_ext77gitlab # [ 0.000000] ftrace: allocating 74867 entries in 294 pages78gitlab # [ 0.000000] ftrace: allocated 294 pages with 4 groups79gitlab # [ 0.000000] rcu: Hierarchical RCU implementation.80gitlab # [ 0.000000] rcu: RCU event tracing is enabled.81gitlab # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.82gitlab # [ 0.000000] Trampoline variant of Tasks RCU enabled.83gitlab # [ 0.000000] Rude variant of Tasks RCU enabled.84gitlab # [ 0.000000] Tracing variant of Tasks RCU enabled.85gitlab # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.86gitlab # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=487gitlab # [ 0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.88gitlab # [ 0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.89gitlab # [ 0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.90gitlab # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 091gitlab # [ 0.000000] GICv3: 256 SPIs implemented92gitlab # [ 0.000000] GICv3: 0 Extended SPIs implemented93gitlab # [ 0.000000] Root IRQ handler: gic_handle_irq94gitlab # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI95gitlab # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=096gitlab # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a000097gitlab # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]98gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f10000 (indirect, esz 8, psz 64K, shr 1)99gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f20000 (flat, esz 8, psz 64K, shr 1)100gitlab # [ 0.000000] GICv3: using LPI property table @0x0000000100f30000101gitlab # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f40000102gitlab # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.103gitlab # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns104gitlab # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).105gitlab # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns106gitlab # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns107gitlab # [ 0.000031] arm-pv: using stolen time PV108gitlab # [ 0.000434] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)109gitlab # [ 0.000634] Console: colour dummy device 80x25110gitlab # [ 0.000641] printk: legacy console [tty0] enabled111gitlab # [ 0.000828] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)112gitlab # [ 0.000834] pid_max: default: 32768 minimum: 301113gitlab # [ 0.000907] LSM: initializing lsm=capability,landlock,yama,bpf,ima114gitlab # [ 0.001038] landlock: Up and running.115gitlab # [ 0.001041] Yama: becoming mindful.116gitlab # [ 0.001510] LSM support for eBPF active117gitlab # [ 0.001715] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)118gitlab # [ 0.001823] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)119gitlab # [ 0.002997] cacheinfo: Unable to detect cache hierarchy for CPU 0120gitlab # [ 0.003708] rcu: Hierarchical SRCU implementation.121gitlab # [ 0.003712] rcu: Max phase no-delay instances is 1000.122gitlab # [ 0.003862] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level123gitlab # [ 0.004903] fsl-mc MSI: its@8080000 domain created124gitlab # [ 0.004997] EFI services will not be available.125gitlab # [ 0.005157] smp: Bringing up secondary CPUs ...126gitlab # [ 0.005798] Detected PIPT I-cache on CPU1127gitlab # [ 0.005900] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000128gitlab # [ 0.006036] GICv3: CPU1: using allocated LPI pending table @0x0000000100f50000129gitlab # [ 0.006169] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40]130gitlab # [ 0.007278] Detected PIPT I-cache on CPU2131gitlab # [ 0.007387] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000132gitlab # [ 0.007522] GICv3: CPU2: using allocated LPI pending table @0x0000000100f60000133gitlab # [ 0.007653] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40]134gitlab # [ 0.008789] Detected PIPT I-cache on CPU3135gitlab # [ 0.008911] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000136gitlab # [ 0.009047] GICv3: CPU3: using allocated LPI pending table @0x0000000100f70000137gitlab # [ 0.009181] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40]138gitlab # [ 0.009696] smp: Brought up 1 node, 4 CPUs139gitlab # [ 0.009722] SMP: Total of 4 processors activated.140gitlab # [ 0.009724] CPU: All CPU(s) started at EL1141gitlab # [ 0.009733] CPU features: detected: Branch Target Identification142gitlab # [ 0.009737] CPU features: detected: ARMv8.4 Translation Table Level143gitlab # [ 0.009740] CPU features: detected: Instruction cache invalidation not required for I/D coherence144gitlab # [ 0.009743] CPU features: detected: Data cache clean to the PoU not required for I/D coherence145gitlab # [ 0.009746] CPU features: detected: Common not Private translations146gitlab # [ 0.009749] CPU features: detected: CRC32 instructions147gitlab # [ 0.009751] CPU features: detected: Data cache clean to Point of Deep Persistence148gitlab # [ 0.009755] CPU features: detected: Data cache clean to Point of Persistence149gitlab # [ 0.009758] CPU features: detected: Data independent timing control (DIT)150gitlab # [ 0.009761] CPU features: detected: E0PD151gitlab # [ 0.009763] CPU features: detected: Enhanced Counter Virtualization152gitlab # [ 0.009766] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)153gitlab # [ 0.009768] CPU features: detected: Enhanced Virtualization Traps154gitlab # [ 0.009771] CPU features: detected: Fine Grained Traps155gitlab # [ 0.009774] CPU features: detected: Generic authentication (architected QARMA5 algorithm)156gitlab # [ 0.009778] CPU features: detected: RCpc load-acquire (LDAPR)157gitlab # [ 0.009780] CPU features: detected: LSE atomic instructions158gitlab # [ 0.009783] CPU features: detected: Privileged Access Never159gitlab # [ 0.009785] CPU features: detected: PMUv3160gitlab # [ 0.009788] CPU features: detected: RAS Extension Support161gitlab # [ 0.009790] CPU features: detected: RASv1p1 Extension Support162gitlab # [ 0.009793] CPU features: detected: Random Number Generator163gitlab # [ 0.009795] CPU features: detected: Speculation barrier (SB)164gitlab # [ 0.009797] CPU features: detected: Stage-2 Force Write-Back165gitlab # [ 0.009800] CPU features: detected: TLB range maintenance instructions166gitlab # [ 0.009803] CPU features: detected: Speculative Store Bypassing Safe (SSBS)167gitlab # [ 0.009940] alternatives: applying system-wide alternatives168gitlab # [ 0.012916] CPU features: detected: BBM Level 2 without TLB conflict abort169gitlab # [ 0.013159] Memory: 5963788K/6291456K available (24448K kernel code, 7090K rwdata, 26340K rodata, 4736K init, 1106K bss, 272908K reserved, 32768K cma-reserved)170gitlab # [ 0.014655] devtmpfs: initialized171gitlab # [ 0.018800] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)172gitlab # [ 0.018869] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).173gitlab # [ 0.019056] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL174gitlab # [ 0.019061] 0 pages in range for non-PLT usage175gitlab # [ 0.019062] 508288 pages in range for PLT usage176gitlab # [ 0.019157] pinctrl core: initialized pinctrl subsystem177gitlab # [ 0.019934] DMI not present or invalid.178gitlab # [ 0.023322] NET: Registered PF_NETLINK/PF_ROUTE protocol family179gitlab # [ 0.025990] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations180gitlab # [ 0.026288] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations181gitlab # [ 0.028128] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations182gitlab # [ 0.028150] audit: initializing netlink subsys (disabled)183gitlab # [ 0.028485] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1184gitlab # [ 0.028924] thermal_sys: Registered thermal governor 'fair_share'185gitlab # [ 0.028927] thermal_sys: Registered thermal governor 'bang_bang'186gitlab # [ 0.028932] thermal_sys: Registered thermal governor 'step_wise'187gitlab # [ 0.028934] thermal_sys: Registered thermal governor 'user_space'188gitlab # [ 0.028937] thermal_sys: Registered thermal governor 'power_allocator'189gitlab # [ 0.029077] cpuidle: using governor ladder190gitlab # [ 0.029150] cpuidle: using governor menu191gitlab # [ 0.029347] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.192gitlab # [ 0.029567] ASID allocator initialised with 65536 entries193gitlab # [ 0.030721] Serial: AMBA PL011 UART driver194gitlab # [ 0.035947] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1195gitlab # [ 0.036245] printk: console [ttyAMA0] enabled196gitlab # [ 0.042840] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages197gitlab # [ 0.042847] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page198gitlab # [ 0.042849] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages199gitlab # [ 0.042852] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page200gitlab # [ 0.042855] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages201gitlab # [ 0.042858] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page202gitlab # [ 0.042861] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages203gitlab # [ 0.042863] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page204gitlab # [ 0.055555] fbcon: Taking over console205gitlab # [ 0.055588] ACPI: Interpreter disabled.206gitlab # [ 0.058583] iommu: Default domain type: Translated207gitlab # [ 0.058590] iommu: DMA domain TLB invalidation policy: strict mode208gitlab # [ 0.074860] SCSI subsystem initialized209gitlab # [ 0.075743] usbcore: registered new interface driver usbfs210gitlab # [ 0.075974] usbcore: registered new interface driver hub211gitlab # [ 0.076059] usbcore: registered new device driver usb212gitlab # [ 0.076955] pps_core: LinuxPPS API ver. 1 registered213gitlab # [ 0.076966] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>214gitlab # [ 0.076991] PTP clock support registered215gitlab # [ 0.077108] EDAC MC: Ver: 3.0.0216gitlab # [ 0.077734] scmi_core: SCMI protocol bus registered217gitlab # [ 0.078722] FPGA manager framework218gitlab # [ 0.081073] vgaarb: loaded219gitlab # [ 0.081977] clocksource: Switched to clocksource arch_sys_counter220gitlab # [ 0.082578] VFS: Disk quotas dquot_6.6.0221gitlab # [ 0.082609] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)222gitlab # [ 0.085379] netfs: FS-Cache loaded223gitlab # [ 0.085944] pnp: PnP ACPI: disabled224gitlab # [ 0.095895] NET: Registered PF_INET protocol family225gitlab # [ 0.098020] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)226gitlab # [ 0.150649] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)227gitlab # [ 0.150715] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)228gitlab # [ 0.150774] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)229gitlab # [ 0.151156] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)230gitlab # [ 0.151997] TCP: Hash tables configured (established 65536 bind 65536)231gitlab # [ 0.152139] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)232gitlab # [ 0.152209] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)233gitlab # [ 0.152375] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)234gitlab # [ 0.152654] NET: Registered PF_UNIX/PF_LOCAL protocol family235gitlab # [ 0.152687] NET: Registered PF_XDP protocol family236gitlab # [ 0.152705] PCI: CLS 0 bytes, default 64237gitlab # [ 0.153126] Trying to unpack rootfs image as initramfs...238gitlab # [ 0.170528] kvm [1]: HYP mode not available239gitlab # [ 0.238862] Initialise system trusted keyrings240gitlab # [ 0.239113] workingset: timestamp_bits=42 max_order=21 bucket_order=0241gitlab # [ 0.242486] squashfs: version 4.0 (2009/01/31) Phillip Lougher242gitlab # [ 0.242607] 9p: Installing v9fs 9p2000 file system support243gitlab # [ 0.260772] Key type asymmetric registered244gitlab # [ 0.260790] Asymmetric key parser 'x509' registered245gitlab # [ 0.260856] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)246gitlab # [ 0.261081] io scheduler mq-deadline registered247gitlab # [ 0.261090] io scheduler kyber registered248gitlab # [ 0.272687] pl061_gpio 9030000.pl061: PL061 GPIO chip registered249gitlab # [ 0.274080] ledtrig-cpu: registered to indicate activity on CPUs250gitlab # [ 0.274655] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:251gitlab # [ 0.274675] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000252gitlab # [ 0.274690] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000253gitlab # [ 0.274699] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000254gitlab # [ 0.274759] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits255gitlab # [ 0.274788] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]256gitlab # [ 0.274899] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00257gitlab # [ 0.274910] pci_bus 0000:00: root bus resource [bus 00-ff]258gitlab # [ 0.274916] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]259gitlab # [ 0.274921] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]260gitlab # [ 0.274926] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]261gitlab # [ 0.275085] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint262gitlab # [ 0.275869] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint263gitlab # [ 0.276224] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]264gitlab # [ 0.276244] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]265gitlab # [ 0.276296] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]266gitlab # [ 0.276316] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]267gitlab # [ 0.277105] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint268gitlab # [ 0.277452] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]269gitlab # [ 0.277471] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]270gitlab # [ 0.277515] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]271gitlab # [ 0.278335] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint272gitlab # [ 0.278678] pci 0000:00:03.0: BAR 0 [io 0x0000-0x001f]273gitlab # [ 0.278696] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]274gitlab # [ 0.278747] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]275gitlab # [ 0.279548] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint276gitlab # [ 0.279907] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]277gitlab # [ 0.279927] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]278gitlab # [ 0.279971] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]279gitlab # [ 0.280776] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint280gitlab # [ 0.281118] pci 0000:00:05.0: BAR 0 [io 0x0000-0x007f]281gitlab # [ 0.281137] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]282gitlab # [ 0.281181] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]283gitlab # [ 0.281968] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint284gitlab # [ 0.282303] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]285gitlab # [ 0.282323] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]286gitlab # [ 0.282374] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]287gitlab # [ 0.283201] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint288gitlab # [ 0.283540] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]289gitlab # [ 0.283559] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]290gitlab # [ 0.283610] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]291gitlab # [ 0.283630] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]292gitlab # [ 0.284478] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint293gitlab # [ 0.284843] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]294gitlab # [ 0.284887] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]295gitlab # [ 0.285664] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint296gitlab # [ 0.286027] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]297gitlab # [ 0.286072] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]298gitlab # [ 0.286796] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint299gitlab # [ 0.287143] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]300gitlab # [ 0.287584] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint301gitlab # [ 0.287996] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]302gitlab # [ 0.288016] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]303gitlab # [ 0.288060] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]304gitlab # [ 0.288864] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint305gitlab # [ 0.289200] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]306gitlab # [ 0.289219] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]307gitlab # [ 0.289263] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]308gitlab # [ 0.290262] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned309gitlab # [ 0.290273] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned310gitlab # [ 0.290279] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned311gitlab # [ 0.290348] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned312gitlab # [ 0.290419] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned313gitlab # [ 0.290490] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned314gitlab # [ 0.290563] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned315gitlab # [ 0.290644] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned316gitlab # [ 0.290715] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned317gitlab # [ 0.290785] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned318gitlab # [ 0.290855] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned319gitlab # [ 0.290932] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned320gitlab # [ 0.291025] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned321gitlab # [ 0.291103] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned322gitlab # [ 0.291133] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned323gitlab # [ 0.291161] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned324gitlab # [ 0.291196] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned325gitlab # [ 0.291226] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned326gitlab # [ 0.291255] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned327gitlab # [ 0.291284] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned328gitlab # [ 0.291314] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned329gitlab # [ 0.291344] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned330gitlab # [ 0.291380] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned331gitlab # [ 0.291411] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned332gitlab # [ 0.291441] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned333gitlab # [ 0.291476] pci 0000:00:05.0: BAR 0 [io 0x1000-0x107f]: assigned334gitlab # [ 0.291505] pci 0000:00:06.0: BAR 0 [io 0x1080-0x10ff]: assigned335gitlab # [ 0.291540] pci 0000:00:0b.0: BAR 0 [io 0x1100-0x113f]: assigned336gitlab # [ 0.291568] pci 0000:00:01.0: BAR 0 [io 0x1140-0x115f]: assigned337gitlab # [ 0.291603] pci 0000:00:02.0: BAR 0 [io 0x1160-0x117f]: assigned338gitlab # [ 0.291632] pci 0000:00:03.0: BAR 0 [io 0x1180-0x119f]: assigned339gitlab # [ 0.291661] pci 0000:00:04.0: BAR 0 [io 0x11a0-0x11bf]: assigned340gitlab # [ 0.291696] pci 0000:00:07.0: BAR 0 [io 0x11c0-0x11df]: assigned341gitlab # [ 0.291726] pci 0000:00:0c.0: BAR 0 [io 0x11e0-0x11ff]: assigned342gitlab # [ 0.291762] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]343gitlab # [ 0.291770] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]344gitlab # [ 0.291776] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]345gitlab # [ 0.293887] pci 0000:00:0a.0: enabling device (0000 -> 0002)346gitlab # [ 0.311253] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)347gitlab # [ 0.314199] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)348gitlab # [ 0.317000] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)349gitlab # [ 0.320233] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)350gitlab # [ 0.326014] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)351gitlab # [ 0.328857] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)352gitlab # [ 0.331715] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)353gitlab # [ 0.334574] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)354gitlab # [ 0.340763] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)355gitlab # [ 0.343321] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)356gitlab # [ 0.346183] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)357gitlab # [ 0.352655] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled358gitlab # [ 0.355104] msm_serial: driver initialized359gitlab # [ 0.355317] SuperH (H)SCI(F) driver initialized360gitlab # [ 0.355384] STM32 USART driver initialized361gitlab # [ 0.391939] loop: module loaded362gitlab # [ 0.392508] virtio_blk virtio4: 4/0/0 default/read/poll queues363gitlab # [ 0.397853] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)364gitlab # [ 0.402724] virtio_blk virtio5: 4/0/0 default/read/poll queues365gitlab # [ 0.407845] virtio_blk virtio5: [vdb] 12283448 512-byte logical blocks (6.29 GB/5.86 GiB)366gitlab # [ 0.413206] megasas: 07.734.00.00-rc1367gitlab # [ 0.415235] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]368gitlab # [ 0.421165] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000369gitlab # [ 0.421327] Intel/Sharp Extended Query Table at 0x0031370gitlab # [ 0.426663] Using buffer write method371gitlab # [ 0.426736] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]372gitlab # [ 0.431442] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000373gitlab # [ 0.431478] Intel/Sharp Extended Query Table at 0x0031374gitlab # [ 0.436235] Using buffer write method375gitlab # [ 0.436272] Concatenating MTD devices:376gitlab # [ 0.436279] (0): "0.flash"377gitlab # [ 0.436286] (1): "0.flash"378gitlab # [ 0.436292] into device "0.flash"379gitlab # [ 0.591611] Freeing initrd memory: 27184K380gitlab # [ 0.609594] tun: Universal TUN/TAP device driver, 1.6381gitlab # [ 0.618462] thunder_xcv, ver 1.0382gitlab # [ 0.618556] thunder_bgx, ver 1.0383gitlab # [ 0.618627] nicpf, ver 1.0384gitlab # [ 0.620351] e1000: Intel(R) PRO/1000 Network Driver385gitlab # [ 0.620363] e1000: Copyright (c) 1999-2006 Intel Corporation.386gitlab # [ 0.620432] e1000e: Intel(R) PRO/1000 Network Driver387gitlab # [ 0.620447] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.388gitlab # [ 0.620633] igb: Intel(R) Gigabit Ethernet Network Driver389gitlab # [ 0.620646] igb: Copyright (c) 2007-2014 Intel Corporation.390gitlab # [ 0.620723] igbvf: Intel(R) Gigabit Virtual Function Network Driver391gitlab # [ 0.620734] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.392gitlab # [ 0.621141] sky2: driver version 1.30393gitlab # [ 0.625496] ehci-pci 0000:00:0a.0: EHCI Host Controller394gitlab # [ 0.625528] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1395gitlab # [ 0.625809] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000396gitlab # [ 0.626133] usbcore: registered new interface driver usb-storage397gitlab # [ 0.626501] usbcore: registered new interface driver usbserial_generic398gitlab # [ 0.626547] usbserial: USB Serial support registered for generic399gitlab # [ 0.628392] hv_vmbus: registering driver hyperv_keyboard400gitlab # [ 0.630959] rtc-pl031 9010000.pl031: registered as rtc0401gitlab # [ 0.631017] rtc-pl031 9010000.pl031: setting system clock to 2026-09-03T10:13:03 UTC (1788430383)402gitlab # [ 0.631921] i2c_dev: i2c /dev entries driver403gitlab # [ 0.638029] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00404gitlab # [ 0.638668] hub 1-0:1.0: USB hub found405gitlab # [ 0.638701] hub 1-0:1.0: 6 ports detected406gitlab # [ 0.640603] sdhci: Secure Digital Host Controller Interface driver407gitlab # [ 0.640618] sdhci: Copyright(c) Pierre Ossman408gitlab # [ 0.641465] Synopsys Designware Multimedia Card Interface Driver409gitlab # [ 0.642669] sdhci-pltfm: SDHCI platform and OF driver helper410gitlab # [ 0.647659] hid: raw HID events driver (C) Jiri Kosina411gitlab # [ 0.648543] usbcore: registered new interface driver usbhid412gitlab # [ 0.648553] usbhid: USB HID core driver413gitlab # [ 0.654772] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available414gitlab # [ 0.658753] drop_monitor: Initializing network drop monitor service415gitlab # [ 0.659125] NET: Registered PF_INET6 protocol family416gitlab # [ 0.660758] Segment Routing with IPv6417gitlab # [ 0.660787] In-situ OAM (IOAM) with IPv6418gitlab # [ 0.660844] NET: Registered PF_PACKET protocol family419gitlab # [ 0.661115] 9pnet: Installing 9P2000 support420gitlab # [ 0.664736] Key type dns_resolver registered421gitlab # [ 0.680847] registered taskstats version 1422gitlab # [ 0.681346] Loading compiled-in X.509 certificates423gitlab # [ 0.700100] Demotion targets for Node 0: null424gitlab # [ 0.700314] Key type .fscrypt registered425gitlab # [ 0.700321] Key type fscrypt-provisioning registered426gitlab # [ 0.700493] ima: No TPM chip found, activating TPM-bypass!427gitlab # [ 0.700515] ima: Allocated hash algorithm: sha1428gitlab # [ 0.700543] ima: No architecture policies found429gitlab # [ 0.701603] input: gpio-keys as /devices/platform/gpio-keys/input/input0430gitlab # [ 0.726083] clk: Disabling unused clocks431gitlab # [ 0.726107] PM: genpd: Disabling unused power domains432gitlab # [ 0.730731] Freeing unused kernel memory: 4736K433gitlab # [ 0.730945] Run /init as init process434gitlab # [ 0.760509] systemd[1]: Successfully made /usr/ read-only.435gitlab # [ 0.886081] usb 1-1: new high-speed USB device number 2 using ehci-pci436gitlab # [ 1.044554] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1437gitlab # [ 1.094953] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)438gitlab # [ 1.095021] systemd[1]: Detected virtualization qemu.439gitlab # [ 1.095094] systemd[1]: Detected architecture arm64.440gitlab # [ 1.095109] systemd[1]: Running in initrd.441gitlab # [ 1.095962] systemd[1]: Initializing machine ID from random generator.442gitlab # [ 1.096332] systemd[1]: Hostname set to <gitlab>.443gitlab # [ 1.190609] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0444gitlab # [ 1.310055] usb 1-2: new high-speed USB device number 3 using ehci-pci445gitlab # [ 1.384007] systemd[1]: bpf-restrict-fs: LSM BPF program attached446gitlab # [ 1.462175] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2447gitlab # [ 1.462593] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0448gitlab # [ 1.488409] systemd[1]: Queued start job for default target Initrd Default Target.449gitlab # [ 1.505937] systemd[1]: Created slice Slice /system/modprobe.450gitlab # [ 1.506384] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.451gitlab # [ 1.506434] systemd[1]: Expecting device /dev/disk/by-label/nix-store...452gitlab # [ 1.506454] systemd[1]: Expecting device /dev/disk/by-label/nixos...453gitlab # [ 1.506490] systemd[1]: Reached target Path Units.454gitlab # [ 1.506514] systemd[1]: Reached target Slice Units.455gitlab # [ 1.506541] systemd[1]: Reached target Swaps.456gitlab # [ 1.506568] systemd[1]: Reached target Timer Units.457gitlab # [ 1.506871] systemd[1]: Listening on D-Bus System Message Bus Socket.458gitlab # [ 1.507110] systemd[1]: Listening on Journal Socket (/dev/log).459gitlab # [ 1.507349] systemd[1]: Listening on Journal Sockets.460gitlab # [ 1.507557] systemd[1]: Listening on udev Control Socket.461gitlab # [ 1.507686] systemd[1]: Listening on udev Kernel Socket.462gitlab # [ 1.507719] systemd[1]: Reached target Socket Units.463gitlab # [ 1.510126] systemd[1]: Starting Create List of Static Device Nodes...464gitlab # [ 1.512495] systemd[1]: Starting Load Kernel Module 9pnet_virtio...465gitlab # [ 1.512599] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs466gitlab # [ 1.515065] systemd[1]: Mounting Kernel Configuration File System...467gitlab # [ 1.541829] systemd[1]: Starting Journal Service...468gitlab # [ 1.544063] systemd[1]: Starting Load Kernel Modules...469gitlab # [ 1.544182] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os470gitlab # [ 1.550193] systemd[1]: Starting Coldplug All udev Devices...471gitlab # [ 1.552680] systemd[1]: Finished Create List of Static Device Nodes.472gitlab # [ 1.557819] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.473gitlab # [ 1.558359] systemd[1]: Finished Load Kernel Module 9pnet_virtio.474gitlab # [ 1.562677] systemd[1]: Mounted Kernel Configuration File System.475gitlab # [ 1.566448] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...476gitlab # [ 1.585064] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.477gitlab # [ 1.585498] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev478gitlab # [ 1.593299] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.479gitlab # [ 1.594335] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0480gitlab # [ 1.594522] [drm] features: -virgl +edid -resource_blob -host_visible481gitlab # [ 1.594525] [drm] features: -context_init482gitlab # [ 1.595431] [drm] number of scanouts: 1483gitlab # [ 1.595445] [drm] number of cap sets: 0484gitlab # [ 1.596026] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic485gitlab # [ 1.596033] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0486gitlab # [ 1.596261] systemd[1]: Starting Create Static Device Nodes in /dev...487gitlab # [ 1.604042] Console: switching to colour frame buffer device 160x50488gitlab # [ 1.612241] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device489gitlab # [ 1.616966] systemd-journald[96]: Collecting audit messages is disabled.490gitlab # [ 1.622404] systemd[1]: Finished Create Static Device Nodes in /dev.491gitlab # [ 1.622858] systemd[1]: Reached target Preparation for Local File Systems.492gitlab # [ 1.623446] systemd[1]: Reached target Local File Systems.493gitlab # [ 1.630813] systemd[1]: Starting Rule-based Manager for Device Events and Files...494gitlab # [ 1.639128] systemd[1]: Finished Load Kernel Modules.495gitlab # [ 1.642177] systemd[1]: Starting Apply Kernel Variables...496gitlab # [ 1.679059] systemd[1]: Started Journal Service.497gitlab # [ 1.678206] systemd-modules-load[97]: Using 4 probe threads498gitlab # [ 1.680994] systemd-modules-load[97]: Module 'virtio_balloon' is built in499gitlab # [ 1.682119] systemd-modules-load[97]: Module 'virtio_console' is built in500gitlab # [ 1.683203] systemd-modules-load[97]: Module 'virtio_rng' is built in501gitlab # [ 1.684257] systemd-modules-load[97]: Inserted module 'dm_mod'502gitlab # [ 1.685197] systemd-modules-load[97]: Inserted module 'virtio_gpu'503gitlab # [ 1.686197] systemd[1]: Starting Create System Files and Directories...504gitlab # [ 1.688509] systemd[1]: Finished Apply Kernel Variables.505gitlab # [ 1.707218] systemd[1]: Finished Create System Files and Directories.506gitlab # [ 1.710822] systemd-udevd[106]: Using default interface naming scheme 'v261'.507gitlab # [ 1.724423] systemd[1]: Started Rule-based Manager for Device Events and Files.508gitlab # [ 1.752598] systemd[1]: Starting Virtual Console Setup...509gitlab # [ 1.830171] systemd-vconsole-setup[130]: Configuration of first virtual console was skipped, ignoring remaining ones.510gitlab # [ 1.835362] systemd[1]: Finished Virtual Console Setup.511gitlab # [ 2.167115] systemd[1]: Finished Coldplug All udev Devices.512gitlab # [ 2.169785] systemd[1]: Reached target System Initialization.513gitlab # [ 2.172325] systemd[1]: Reached target Basic System.514gitlab # [ 2.358945] (udev-worker)[120]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.515gitlab # [ 2.364783] (udev-worker)[120]: Network interface NamePolicy= disabled on kernel command line.516gitlab # [ 2.374714] (udev-worker)[145]: Network interface NamePolicy= disabled on kernel command line.517gitlab # [ 2.411575] systemd[1]: Found device /dev/disk/by-label/nix-store.518gitlab # [ 2.421220] systemd[1]: Found device /dev/disk/by-label/nixos.519gitlab # [ 2.422708] systemd[1]: Reached target Initrd Root Device.520gitlab # [ 2.424601] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...521gitlab # [ 2.477633] systemd-fsck[152]: nixos: clean, 12/65536 files, 13019/262144 blocks522gitlab # [ 2.482304] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.523gitlab # [ 2.551147] systemd[1]: Mounting /sysroot...524gitlab # [ 2.611492] EXT4-fs (vda): mounted filesystem 16294c7f-afc8-4a9b-99f8-05be6d990efb r/w with ordered data mode. Quota mode: none.525gitlab # [ 2.611567] systemd[1]: Mounted /sysroot.526gitlab # [ 2.613033] systemd[1]: Reached target Initrd Root File System.527gitlab # [ 2.615202] systemd[1]: Mounting /sysroot/nix/.ro-store...528gitlab # [ 2.618097] systemd[1]: Mounting /sysroot/nix/.rw-store...529gitlab # [ 2.621890] systemd[1]: Mounting /sysroot/run...530gitlab # [ 2.625319] systemd[1]: Mounting /sysroot/tmp/shared...531gitlab # [ 2.655081] systemd[1]: Mounting /sysroot/tmp/xchg...532gitlab # [ 2.659740] systemd[1]: Starting Mountpoints Configured in the Real Root...533gitlab # [ 2.673292] systemd[1]: Mounted /sysroot/nix/.rw-store.534gitlab # [ 2.674157] systemd[1]: Mounted /sysroot/run.535gitlab # [ 2.678813] systemd-sysroot-fstab-check[165]: /sysroot should be mounted in the initrd, will request daemon-reload.536gitlab # [ 2.684806] systemd[1]: Mounted /sysroot/tmp/shared.537gitlab # [ 2.685975] systemd[1]: Mounted /sysroot/tmp/xchg.538gitlab # [ 2.689169] systemd[1]: Starting rw-sysroot-nix-store.service...539gitlab # [ 2.692304] erofs (device vdb): mounted with root inode @ nid 128.540gitlab # [ 2.692125] systemd[1]: Reload requested from client PID 165 ('systemd-sysroot') (unit initrd-parse-etc.service)...541gitlab # [ 2.695374] systemd[1]: Reloading...542gitlab # [ 2.801445] systemd[1]: Reloading finished in 110 ms.543gitlab # [ 2.855029] systemd-sysroot-fstab-check[165]: Requesting initrd-fs.target/start/replace...544gitlab # [ 2.857862] systemd[1]: Mounted /sysroot/nix/.ro-store.545gitlab # [ 2.858782] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.546gitlab # [ 2.859781] systemd[1]: Finished rw-sysroot-nix-store.service.547gitlab # [ 2.861319] systemd-sysroot-fstab-check[165]: Requesting swap.target/start/replace...548gitlab # [ 2.864177] systemd[1]: Starting rw-sysroot-nix-store.service...549gitlab # [ 2.865081] systemd[1]: initrd-parse-etc.service: Deactivated successfully.550gitlab # [ 2.866026] systemd[1]: Finished Mountpoints Configured in the Real Root.551gitlab # [ 2.866965] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.552gitlab # [ 2.890632] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.553gitlab # [ 2.893189] systemd[1]: Finished rw-sysroot-nix-store.service.554gitlab # [ 2.938971] (udev-worker)[134]: mtd0ro: Failed to find and pin callout binary "/nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/mtd_probe": No such file or directory555gitlab # [ 2.942439] (udev-worker)[134]: mtd0ro: /nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory556gitlab # [ 2.947360] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.557gitlab # [ 2.948870] systemd[1]: Stopped Virtual Console Setup.558gitlab # [ 2.949792] systemd[1]: Stopping Virtual Console Setup...559gitlab # [ 2.950863] systemd[1]: Starting Virtual Console Setup...560gitlab # [ 3.001085] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.561gitlab # [ 3.002784] systemd[1]: Stopped Virtual Console Setup.562gitlab # [ 3.003972] systemd[1]: Starting Virtual Console Setup...563gitlab # [ 3.038400] systemd-vconsole-setup[197]: Configuration of first virtual console was skipped, ignoring remaining ones.564gitlab # [ 3.043295] systemd[1]: Finished Virtual Console Setup.565gitlab # [ 3.557192] systemd[1]: Mounting /sysroot/nix/store...566gitlab # [ 3.624315] systemd[1]: Mounted /sysroot/nix/store.567gitlab # [ 3.626687] systemd[1]: Reached target Initrd File Systems.568gitlab # [ 3.629252] systemd[1]: Starting Find NixOS closure...569gitlab # [ 3.632232] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...570gitlab # [ 3.680576] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.571gitlab # [ 3.684186] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.572gitlab # [ 3.705329] systemd[1]: Finished Find NixOS closure.573gitlab # [ 3.707672] systemd[1]: Reached target Initrd Default Target.574gitlab # [ 3.710262] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...575gitlab # [ 3.773896] systemd[1]: Stopped target Initrd Default Target.576gitlab # [ 3.776596] systemd[1]: Stopped target Basic System.577gitlab # [ 3.778761] systemd[1]: Stopped target Initrd Root Device.578gitlab # [ 3.781226] systemd[1]: Stopped target Path Units.579gitlab # [ 3.783370] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.580gitlab # [ 3.786715] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.581gitlab # [ 3.790017] systemd[1]: Stopped target Slice Units.582gitlab # [ 3.792185] systemd[1]: Stopped target Socket Units.583gitlab # [ 3.794355] systemd[1]: Stopped target System Initialization.584gitlab # [ 3.796905] systemd[1]: Stopped target Swaps.585gitlab # [ 3.800581] systemd[1]: Stopped target Timer Units.586gitlab # [ 3.804327] systemd[1]: dbus.socket: Deactivated successfully.587gitlab # [ 3.808971] systemd[1]: Closed D-Bus System Message Bus Socket.588gitlab # [ 3.811582] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.589gitlab # [ 3.815152] systemd[1]: Stopped Find NixOS closure.590gitlab # [ 3.817166] systemd[1]: Starting Load Kernel Module 9pnet_virtio...591gitlab # [ 3.819491] systemd[1]: Starting rw-sysroot-nix-store.service...592gitlab # [ 3.821802] systemd[1]: systemd-sysctl.service: Deactivated successfully.593gitlab # [ 3.824250] systemd[1]: Stopped Apply Kernel Variables.594gitlab # [ 3.826501] systemd[1]: systemd-modules-load.service: Deactivated successfully.595gitlab # [ 3.829142] systemd[1]: Stopped Load Kernel Modules.596gitlab # [ 3.830818] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.597gitlab # [ 3.833428] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.598gitlab # [ 3.835696] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.599gitlab # [ 3.838019] systemd[1]: Stopped Create System Files and Directories.600gitlab # [ 3.839803] systemd[1]: Stopped target Local File Systems.601gitlab # [ 3.841506] systemd[1]: Stopped target Preparation for Local File Systems.602gitlab # [ 3.843424] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.603gitlab # [ 3.845508] systemd[1]: Stopped Coldplug All udev Devices.604gitlab # [ 3.847080] systemd[1]: Stopping Rule-based Manager for Device Events and Files...605gitlab # [ 3.849227] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.606gitlab # [ 3.851282] systemd[1]: Stopped Virtual Console Setup.607gitlab # [ 3.852815] systemd[1]: initrd-cleanup.service: Deactivated successfully.608gitlab # [ 3.854703] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.609gitlab # [ 3.857694] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.610gitlab # [ 3.859717] systemd[1]: Finished rw-sysroot-nix-store.service.611gitlab # [ 3.861515] systemd[1]: systemd-udevd.service: Deactivated successfully.612gitlab # [ 3.863595] systemd[1]: Stopped Rule-based Manager for Device Events and Files.613gitlab # [ 3.865707] systemd[1]: systemd-udevd.service: Consumed 2.161s CPU time over 2.210s wall clock time, 31.5M memory peak.614gitlab # [ 3.868588] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.615gitlab # [ 3.870640] systemd[1]: Finished Load Kernel Module 9pnet_virtio.616gitlab # [ 3.872383] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.617gitlab # [ 3.874378] systemd[1]: Closed udev Control Socket.618gitlab # [ 3.875824] systemd[1]: Starting Cleanup udev Database...619gitlab # [ 3.877472] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.620gitlab # [ 3.879546] systemd[1]: Stopped Create Static Device Nodes in /dev.621gitlab # [ 3.881274] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.622gitlab # [ 3.883351] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.623gitlab # [ 3.885172] systemd[1]: kmod-static-nodes.service: Deactivated successfully.624gitlab # [ 3.886879] systemd[1]: Stopped Create List of Static Device Nodes.625gitlab # [ 3.929519] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.626gitlab # [ 3.932468] systemd[1]: Finished Cleanup udev Database.627gitlab # [ 3.934521] systemd[1]: Reached target Switch Root.628gitlab # [ 3.936509] systemd[1]: Starting NixOS Activation...629gitlab # [ 4.104461] initrd-nixos-activation-start[223]: booting system configuration /nix/store/zrvzfj07rms8rpynnvxgg02kbcah0jql-nixos-system-gitlab-test630gitlab # [ 4.166081] initrd-nixos-activation-start[223]: running activation script...631gitlab # [ 4.495974] initrd-nixos-activation-start[246]: setting up /etc...632gitlab # [ 4.678218] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.633gitlab # [ 4.682973] systemd[1]: Finished NixOS Activation.634gitlab # [ 4.685235] systemd[1]: Starting Switch Root...635gitlab # [ 4.739205] systemd[1]: Switching root.636gitlab # [ 4.998737] systemd-journald[96]: Received SIGTERM from PID 1 (systemd).637gitlab # [ 5.627979] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)638gitlab # [ 5.628501] systemd[1]: Detected virtualization qemu.639gitlab # [ 5.629394] systemd[1]: Detected architecture arm64.640gitlab # [ 5.630728] systemd[1]: Detected first boot.641gitlab # [ 5.633752] systemd[1]: Initializing machine ID from random generator.642gitlab # [ 5.903034] systemd[1]: bpf-restrict-fs: LSM BPF program attached643gitlab # [ 6.056371] systemd[1]: Applying preset policy.644gitlab # [ 6.370082] systemd[1]: Populated /etc with preset unit settings.645gitlab # [ 6.585316] systemd[1]: initrd-switch-root.service: Deactivated successfully.646gitlab # [ 6.585973] systemd[1]: Stopped initrd-switch-root.service.647gitlab # [ 6.589397] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.648gitlab # [ 6.597111] systemd[1]: Created slice Slice /system/getty.649gitlab # [ 6.600705] systemd[1]: Created slice GitLab DevOps Platform Slice.650gitlab # [ 6.604957] systemd[1]: Created slice User and Session Slice.651gitlab # [ 6.605723] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.652gitlab # [ 6.606496] systemd[1]: Started Forward Password Requests to Wall Directory Watch.653gitlab # [ 6.607265] systemd[1]: Expecting device /dev/hvc0...654gitlab # [ 6.608028] systemd[1]: Expecting device /dev/ttyAMA0...655gitlab # [ 6.608888] systemd[1]: Reached target Local Encrypted Volumes.656gitlab # [ 6.609727] systemd[1]: Stopped target initrd-fs.target.657gitlab # [ 6.610611] systemd[1]: Stopped target initrd-root-fs.target.658gitlab # [ 6.611366] systemd[1]: Stopped target initrd-switch-root.target.659gitlab # [ 6.612207] systemd[1]: Reached target Virtual Machines and Containers.660gitlab # [ 6.613070] systemd[1]: Reached target Path Units.661gitlab # [ 6.613857] systemd[1]: Reached target Remote File Systems.662gitlab # [ 6.614667] systemd[1]: Reached target Slice Units.663gitlab # [ 6.615521] systemd[1]: Reached target Swaps.664gitlab # [ 6.617760] systemd[1]: Listening on Query the User Interactively for a Password.665gitlab # [ 6.619954] systemd[1]: Listening on Process Core Dump Socket.666gitlab # [ 6.621421] systemd[1]: Listening on Credential Encryption/Decryption.667gitlab # [ 6.623026] systemd[1]: Listening on Factory Reset Management.668gitlab # [ 6.623667] systemd[1]: Listening on Hostname Service Socket.669gitlab # [ 6.631178] systemd[1]: Starting Journal Log Access Socket...670gitlab # [ 6.633328] systemd[1]: Listening on Journal Audit Socket.671gitlab # [ 6.640618] systemd[1]: Listening on Console Output Muting Service Socket.672gitlab # [ 6.643127] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.673gitlab # [ 6.644803] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os674gitlab # [ 6.646021] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki675gitlab # [ 6.654968] systemd[1]: Listening on Disk Repartitioning Service Socket.676gitlab # [ 6.657225] systemd[1]: Listening on udev Control Socket.677gitlab # [ 6.659389] systemd[1]: Listening on udev Varlink Socket.678gitlab # [ 6.671606] systemd[1]: Mounting Huge Pages File System...679gitlab # [ 6.683915] systemd[1]: Mounting POSIX Message Queue File System...680gitlab # [ 6.704768] systemd[1]: Mounting Kernel Debug File System...681gitlab # [ 6.713822] systemd[1]: Mounting Kernel Trace File System...682gitlab # [ 6.723383] systemd[1]: Starting Create List of Static Device Nodes...683gitlab # [ 6.738409] systemd[1]: Starting Load Kernel Module 9pnet_virtio...684gitlab # [ 6.739942] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs685gitlab # [ 6.747923] systemd[1]: Mounting Kernel Configuration File System...686gitlab # [ 6.749145] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm687gitlab # [ 6.750178] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore688gitlab # [ 6.762193] systemd[1]: Starting Load Kernel Module fuse...689gitlab # [ 6.766911] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67690gitlab # [ 6.786374] systemd[1]: Starting Journal Service...691gitlab # [ 6.791130] systemd[1]: Starting Load Kernel Modules...692gitlab # [ 6.797095] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...693gitlab # [ 6.803060] systemd[1]: Starting Remount Root and Kernel File Systems...694gitlab # [ 6.805881] fuse: init (API version 7.45)695gitlab # [ 6.806154] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os696gitlab # [ 6.822276] systemd[1]: Starting Coldplug All udev Devices...697gitlab # [ 6.839891] systemd[1]: Listening on Journal Log Access Socket.698gitlab # [ 6.840208] systemd-journald[317]: Collecting audit messages is enabled.699gitlab # [ 6.843757] systemd[1]: Mounted Huge Pages File System.700gitlab # [ 6.844542] systemd[1]: Mounted POSIX Message Queue File System.701gitlab # [ 6.845341] systemd[1]: Mounted Kernel Debug File System.702gitlab # [ 6.846469] systemd[1]: Mounted Kernel Trace File System.703gitlab # [ 6.847898] systemd[1]: Finished Create List of Static Device Nodes.704gitlab # [ 6.850897] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.705gitlab # [ 6.851955] systemd[1]: Finished Load Kernel Module 9pnet_virtio.706gitlab # [ 6.852789] systemd[1]: Mounted Kernel Configuration File System.707gitlab # [ 6.853760] systemd[1]: modprobe@fuse.service: Deactivated successfully.708gitlab # [ 6.854986] systemd[1]: Finished Load Kernel Module fuse.709gitlab # [ 6.858237] EXT4-fs (vda): re-mounted 16294c7f-afc8-4a9b-99f8-05be6d990efb.710gitlab # [ 6.863598] systemd[1]: Queued start job for default target Multi-User System.711gitlab # [ 6.867505] systemd[1]: Unnecessary job was removed for /dev/vdb.712gitlab # [ 6.868685] systemd[1]: systemd-journald.service: Deactivated successfully.713gitlab # [ 6.870184] systemd-modules-load[318]: Using 3 probe threads714gitlab # [ 6.871243] systemd-modules-load[318]: Module 'atkbd' is built in715gitlab # [ 6.872462] systemd-modules-load[318]: Module 'loop' is built in716gitlab # [ 6.873805] systemd-modules-load[318]: Inserted module 'tls'717gitlab # [ 6.878248] systemd[1]: Mounting FUSE Control File System...718gitlab # [ 6.882286] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...719gitlab # [ 6.885348] systemd[1]: Started Journal Service.720gitlab # [ 6.903349] systemd[1]: Finished Load Kernel Modules.721gitlab # [ 6.904896] systemd[1]: Finished Remount Root and Kernel File Systems.722gitlab # [ 6.906733] systemd-oomd[320]: No swap; memory pressure usage will be degraded723gitlab # [ 6.910618] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.724gitlab # [ 6.912897] systemd[1]: Listening on Disk Image Download Service Socket.725gitlab # [ 6.916825] systemd[1]: Starting Firewall...726gitlab # [ 6.921208] systemd[1]: Starting Flush Journal to Persistent Storage...727gitlab # [ 6.924369] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore728gitlab # [ 6.935823] systemd[1]: Starting Load/Save OS Random Seed...729gitlab # [ 6.937623] systemd[1]: Starting Apply Kernel Variables...730gitlab # [ 6.938803] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os731gitlab # [ 6.943054] systemd[1]: Mounted FUSE Control File System.732gitlab # [ 6.948410] systemd-journald[317]: Received client request to flush runtime journal.733gitlab # [ 6.983817] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.734gitlab # [ 6.985592] systemd[1]: Starting Create Static Device Nodes in /dev...735gitlab # [ 6.989444] systemd[1]: Finished Load/Save OS Random Seed.736gitlab # [ 6.990697] systemd[1]: Reached target First Boot Complete.737gitlab # [ 6.991566] systemd[1]: Finished Apply Kernel Variables.738gitlab # [ 6.992505] systemd[1]: Finished Flush Journal to Persistent Storage.739gitlab # [ 7.005405] systemd[1]: Finished Create Static Device Nodes in /dev.740gitlab # [ 7.006547] systemd[1]: Reached target Preparation for Local File Systems.741gitlab # [ 7.009699] systemd[1]: Starting Rule-based Manager for Device Events and Files...742gitlab # [ 7.090222] systemd-udevd[359]: Using default interface naming scheme 'v261'.743gitlab # [ 7.137770] systemd[1]: Started Rule-based Manager for Device Events and Files.744gitlab # [ 7.587411] systemd[1]: Finished Firewall.745gitlab # [ 7.594785] systemd[1]: Mounting /run/wrappers...746gitlab # [ 7.636755] systemd[1]: Mounted /run/wrappers.747gitlab # [ 7.641224] systemd[1]: Reached target Local File Systems.748gitlab # [ 7.646663] systemd[1]: Listening on Boot Loader Control Service Socket.749gitlab # [ 7.655116] systemd[1]: Starting register-nix-paths.service...750gitlab # [ 7.663476] systemd[1]: Starting Create SUID/SGID Wrappers...751gitlab # [ 7.667322] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.752gitlab # [ 7.700575] systemd[1]: Starting Save Transient machine-id to Disk...753gitlab # [ 7.710295] systemd[1]: Starting Create System Files and Directories...754gitlab # [ 7.716253] systemd[1]: Finished Coldplug All udev Devices.755gitlab # [ 7.774548] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.756gitlab # [ 7.777595] systemd[1]: Finished Save Transient machine-id to Disk.757gitlab # [ 7.779958] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs758gitlab # [ 7.791775] systemd[1]: Finished Create System Files and Directories.759gitlab # [ 7.798015] systemd[1]: Starting Rebuild Journal Catalog...760gitlab # [ 7.800849] systemd[1]: Starting Record System Boot/Shutdown in UTMP...761gitlab # [ 7.846794] systemd[1]: Finished Record System Boot/Shutdown in UTMP.762gitlab # [ 7.856370] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.763gitlab # [ 7.859571] systemd[1]: Finished Rebuild Journal Catalog.764gitlab # [ 7.868096] systemd[1]: Starting Update is Completed...765gitlab # [ 7.877780] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped.766gitlab # [ 7.894577] (udev-worker)[395]: Network interface NamePolicy= disabled on kernel command line.767gitlab # [ 7.912276] systemd[1]: Finished Update is Completed.768gitlab # [ 7.921639] (udev-worker)[402]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.769gitlab # [ 7.924237] (udev-worker)[402]: Network interface NamePolicy= disabled on kernel command line.770gitlab # [ 7.937009] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.771gitlab # [ 7.938336] systemd[1]: Finished Create SUID/SGID Wrappers.772gitlab # [ 7.939880] systemd[1]: suid-sgid-wrappers.service: Consumed 167ms CPU time over 273ms wall clock time, 5.7M memory peak, 1.9M read from disk.773gitlab # [ 7.942548] systemd[1]: Condition check resulted in Virtio network device being skipped.774gitlab # [ 7.944911] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore775gitlab # [ 7.947121] systemd[1]: Starting Create SUID/SGID Wrappers...776gitlab # [ 7.948304] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.777gitlab # [ 7.951079] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67778gitlab # [ 7.954546] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore779gitlab # [ 7.957010] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os780gitlab # [ 7.960978] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os781gitlab # [ 8.032989] mousedev: PS/2 mouse device common for all mice782gitlab # [ 8.106263] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.783gitlab # [ 8.107948] systemd[1]: Finished Create SUID/SGID Wrappers.784gitlab # [ 8.228231] systemd[1]: Finished register-nix-paths.service.785gitlab # [ 8.229222] systemd[1]: Reached target System Initialization.786gitlab # [ 8.231496] systemd[1]: Started Discard unused filesystem blocks once a week.787gitlab # [ 8.233588] systemd[1]: Started logrotate.timer.788gitlab # [ 8.234485] systemd[1]: Started Daily Cleanup of Temporary Directories.789gitlab # [ 8.235444] systemd[1]: Reached target Timer Units.790gitlab # [ 8.236254] systemd[1]: Listening on D-Bus System Message Bus Socket.791gitlab # [ 8.237171] systemd[1]: Listening on Nix Daemon Socket.792gitlab # [ 8.245661] systemd[1]: Starting nixbot CI service socket...793gitlab # [ 8.247183] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.794gitlab # [ 8.251501] systemd[1]: Starting D-Bus System Message Bus...795gitlab # [ 8.252836] systemd[1]: Listening on nixbot CI service socket.796gitlab # [ 8.253925] systemd[1]: Reached target Socket Units.797gitlab # [ 8.286383] dbus-broker-launch[620]: Looking up NSS user entry for 'systemd-timesync'...798gitlab # [ 8.288152] dbus-broker-launch[620]: NSS returned no entry for 'systemd-timesync'799gitlab # [ 8.289629] dbus-broker-launch[620]: Invalid user-name in /nix/store/9zcyylhndlnizbwn48627991zr1jxg4p-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"800gitlab # [ 8.292482] systemd[1]: Started D-Bus System Message Bus.801gitlab # [ 8.305389] dbus-broker-launch[620]: Ready802gitlab # [ 8.306479] systemd[1]: Reached target Basic System.803gitlab # [ 8.308984] systemd[1]: Started backdoor.service.804gitlab # [ 8.314353] systemd[1]: Starting gitlab-config.service...805gitlab # [ 8.315301] systemd[1]: Starting Import lastlog data into lastlog2 database...806gitlab # [ 8.335938] systemd[1]: Starting Logrotate configuration check...807gitlab # [ 8.350740] systemd[1]: Starting Name Service Cache Daemon (nsncd)...808gitlab # [ 8.355575] systemd[1]: Starting Post-Boot Actions...809gitlab # [ 8.356932] logrotate[625]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.810gitlab # connecting to host...811gitlab # [ 8.359021] logrotate[625]: reading config file /nix/store/22afkmbkaxyx50bj9lbkkpmz7pd69hsf-logrotate.conf812gitlab # [ 8.360961] logrotate[625]: note: 'monthly' overrides previously specified 'weekly'813gitlab # [ 8.368206] systemd[1]: Started Reset console on configuration changes.814gitlab # [ 8.369307] logrotate[625]: Reading state from file: /var/lib/logrotate.status815gitlab # [ 8.370308] logrotate[625]: state file /var/lib/logrotate.status does not exist816gitlab # [ 8.372279] logrotate[625]: Allocating hash table for state file, size 64 entries817gitlab # [ 8.373260] logrotate[625]: Handling 4 logs818gitlab # [ 8.374425] logrotate[625]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed819gitlab # [ 8.379972] logrotate[625]: considering log /var/log/btmp820gitlab # [ 8.380958] logrotate[625]: Creating new state821gitlab # [ 8.381774] logrotate[625]: Now: 2026-09-03 10:13822gitlab # [ 8.383246] logrotate[625]: Last rotated at 2026-09-03 10:00823gitlab: Guest shell says: b'Spawning backdoor root shell...\n'824gitlab # [ 8.385631] logrotate[625]: log does not need rotating (log has already been rotated)825gitlab # [ 8.386628] logrotate[625]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed826gitlab # [ 8.391061] logrotate[625]: considering log /var/log/wtmp827gitlab: connected to guest root shell828gitlab # [ 8.394146] logrotate[625]: Creating new state829gitlab: (connecting took 8.85 seconds)830gitlab # [ 8.394751] logrotate[625]: Now: 2026-09-03 10:13831gitlab: (finished: waiting for the VM to finish booting, in 8.85 seconds)832gitlab # [ 8.395353] logrotate[625]: Last rotated at 2026-09-03 10:00833gitlab # [ 8.396852] logrotate[625]: log does not need rotating (log has already been rotated)834gitlab # [ 8.397805] logrotate[625]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed835gitlab # [ 8.403816] logrotate[625]: switching euid from 0 to 165 and egid from 0 to 165 (pid 625)836gitlab # [ 8.404949] logrotate[625]: considering log /var/gitlab/state/log/*.log837gitlab # [ 8.405899] logrotate[625]: log /var/gitlab/state/log/*.log does not exist -- skipping838gitlab # [ 8.408436] logrotate[625]: Creating new state839gitlab # [ 8.409098] logrotate[625]: switching euid from 165 to 0 and egid from 165 to 0 (pid 625)840gitlab # [ 8.410640] logrotate[625]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed841gitlab # [ 8.414140] logrotate[625]: switching euid from 0 to 60 and egid from 0 to 60 (pid 625)842gitlab # [ 8.415171] logrotate[625]: considering log /var/log/nginx/*.log843gitlab # [ 8.415945] logrotate[625]: log /var/log/nginx/*.log does not exist -- skipping844gitlab # [ 8.417380] logrotate[625]: Creating new state845gitlab # [ 8.418274] logrotate[625]: not running postrotate script, since no logs were rotated846gitlab # [ 8.419561] logrotate[625]: switching euid from 60 to 0 and egid from 60 to 0 (pid 625)847gitlab # [ 8.422072] systemd[1]: Starting resolvconf update...848gitlab # [ 8.423916] nsncd[626]: Sep 03 10:13:11.278 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"849gitlab # [ 8.426412] systemd[1]: Finished Logrotate configuration check.850gitlab # [ 8.429226] systemd[1]: Finished Post-Boot Actions.851gitlab # [ 8.430185] systemd[1]: Finished Import lastlog data into lastlog2 database.852gitlab # [ 8.434752] systemd[1]: Started Name Service Cache Daemon (nsncd).853gitlab # [ 8.435781] systemd[1]: Reached target Host and Network Name Lookups.854gitlab # [ 8.437672] systemd[1]: Reached target User and Group Name Lookups.855gitlab # [ 8.438564] systemd[1]: Starting User Login Management...856gitlab # [ 8.481620] systemd[1]: Stopped target Host and Network Name Lookups.857gitlab # [ 8.482655] systemd[1]: Stopping Host and Network Name Lookups...858gitlab # [ 8.483499] systemd[1]: Stopped target User and Group Name Lookups.859gitlab # [ 8.486807] systemd[1]: Stopping User and Group Name Lookups...860gitlab # [ 8.489685] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...861gitlab # [ 8.497755] systemd[1]: nscd.service: Deactivated successfully.862gitlab # [ 8.498616] systemd[1]: Stopped Name Service Cache Daemon (nsncd).863gitlab # [ 8.499442] systemd[1]: nscd.service: Consumed 26ms CPU time over 158ms wall clock time, 7.3M memory peak, 5.8M read from disk.864gitlab # [ 8.507094] systemd-logind[662]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)865gitlab # [ 8.616465] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3866gitlab # [ 8.567400] systemd-logind[662]: Watching system buttons on /dev/input/event0 (gpio-keys)867gitlab # [ 8.704161] systemd[1]: Starting Name Service Cache Daemon (nsncd)...868gitlab # [ 8.777049] systemd[1]: Finished resolvconf update.869gitlab # [ 8.780165] nsncd[728]: Sep 03 10:13:11.452 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"870gitlab # [ 8.794033] systemd[1]: Reached target Preparation for Network.871gitlab # [ 8.795851] network-addresses-eth1-start[746]: adding address 192.168.1.1/24... done872gitlab # [ 8.797064] network-addresses-eth1-start[746]: adding address 2001:db8:1::1/64... done873gitlab # [ 8.799122] systemd-logind[662]: New seat seat0.874gitlab # [ 8.800065] systemd[1]: Starting DHCP Client...875gitlab # [ 8.800867] systemd[1]: Starting Address configuration of eth1...876gitlab # [ 8.802259] systemd[1]: Starting Extra networking commands....877gitlab # [ 8.803144] systemd[1]: Started Name Service Cache Daemon (nsncd).878gitlab # [ 8.803968] systemd[1]: Finished Address configuration of eth1.879gitlab # [ 8.804905] systemd[1]: Reached target Host and Network Name Lookups.880gitlab # [ 8.805785] systemd[1]: Reached target User and Group Name Lookups.881gitlab # [ 8.806633] systemd[1]: Started User Login Management.882gitlab # [ 8.834457] systemd[1]: Starting linger-users.service...883gitlab # [ 8.879277] dhcpcd[757]: dhcpcd-10.3.2 starting884gitlab # [ 8.888910] dhcpcd[811]: dev: loaded udev885gitlab # [ 8.899960] systemd[1]: Finished Extra networking commands..886gitlab # [ 8.901741] systemd[1]: linger-users.service: Deactivated successfully.887gitlab # [ 8.902645] systemd[1]: Finished linger-users.service.888gitlab # [ 8.910159] systemd[1]: Reached target Network.889gitlab # [ 8.913371] 8021q: 802.1Q VLAN Support v1.8890gitlab # [ 8.913792] 8021q: adding VLAN 0 to HW filter on device eth1891gitlab # [ 8.915871] systemd[1]: Starting gitlab-workhorse.service...892gitlab # [ 8.923586] systemd[1]: Starting Nginx Web Server...893gitlab # [ 8.926740] systemd[1]: Starting PostgreSQL Server...894gitlab # [ 8.931526] systemd[1]: Starting Redis Server - redis-gitlab...895gitlab # [ 8.940733] systemd[1]: Starting Permit User Sessions...896gitlab # [ 8.947662] systemd-logind[662]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)897gitlab # [ 8.962589] cfg80211: Loading compiled-in X.509 certificates for regulatory database898gitlab # [ 8.960789] systemd[1]: Starting Virtual Console Setup...899gitlab # [ 8.973829] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'900gitlab # [ 8.974709] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'901gitlab # [ 8.976885] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2902gitlab # [ 8.977208] cfg80211: failed to load regulatory.db903gitlab # [ 8.984380] systemd[1]: Finished Permit User Sessions.904gitlab # [ 9.000580] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.905gitlab # [ 9.007149] systemd[1]: Started Getty on tty1.906gitlab # [ 9.012690] systemd[1]: Reached target Login Prompts.907gitlab # [ 9.015777] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.908gitlab # [ 9.017334] systemd[1]: Stopped Virtual Console Setup.909gitlab # [ 9.023063] 8021q: adding VLAN 0 to HW filter on device eth0910gitlab # [ 9.023160] dhcpcd[811]: eth0: waiting for carrier911gitlab # [ 9.024433] dhcpcd[811]: eth0: carrier acquired912gitlab # [ 9.030207] dhcpcd[811]: DUID 00:01:00:01:32:2c:04:b7:52:54:00:12:34:56913gitlab # [ 9.031168] dhcpcd[811]: eth0: IAID 00:12:34:56914gitlab # [ 9.031808] dhcpcd[811]: eth0: adding address fe80::5054:ff:fe12:3456915gitlab # [ 9.034208] systemd[1]: Starting Virtual Console Setup...916gitlab # [ 9.097701] systemd-vconsole-setup[848]: Configuration of first virtual console was skipped, ignoring remaining ones.917gitlab # [ 9.100671] systemd[1]: Finished Virtual Console Setup.918gitlab # [ 9.144701] nginx-pre-start[854]: nginx: the configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf syntax is ok919gitlab # [ 9.146805] nginx-pre-start[854]: nginx: configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf test is successful920gitlab # [ 9.149643] redis-server[853]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.921gitlab # [ 9.151917] redis-server[853]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo922gitlab # [ 9.153663] systemd[1]: Started Nginx Web Server.923gitlab # [ 9.154697] redis-server[853]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=853, just started924gitlab # [ 9.156779] redis-server[853]: Configuration loaded925gitlab # [ 9.157985] systemd[1]: Started Redis Server - redis-gitlab.926gitlab # [ 9.159204] redis[853]: monotonic clock: ARM CNTVCT @ 1000 ticks/us927gitlab # [ 9.160442] redis[853]: Running mode=standalone, port=0.928gitlab # [ 9.161748] redis[853]: Server initialized929gitlab # [ 9.162792] redis[853]: Ready to accept connections unix930gitlab # [ 9.163873] redis[853]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.931gitlab # [ 9.180863] postgresql-pre-start[860]: The files belonging to this database system will be owned by user "postgres".932gitlab # [ 9.183007] postgresql-pre-start[860]: This user must also own the server process.933gitlab # [ 9.184775] postgresql-pre-start[860]: The database cluster will be initialized with locale "en_US.UTF-8".934gitlab # [ 9.186213] postgresql-pre-start[860]: The default database encoding has accordingly been set to "UTF8".935gitlab # [ 9.187527] postgresql-pre-start[860]: The default text search configuration will be set to "english".936gitlab # [ 9.189105] postgresql-pre-start[860]: Data page checksums are enabled.937gitlab # [ 9.190221] postgresql-pre-start[860]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok938gitlab # [ 9.191651] postgresql-pre-start[860]: creating subdirectories ... ok939gitlab # [ 9.192660] postgresql-pre-start[860]: selecting dynamic shared memory implementation ... posix940gitlab # [ 9.233075] postgresql-pre-start[860]: selecting default "max_connections" ... 100941gitlab # [ 9.295387] postgresql-pre-start[860]: selecting default "shared_buffers" ... 128MB942gitlab # [ 9.592114] systemd[1]: Started gitlab-workhorse.service.943gitlab # [ 9.772410] postgresql-pre-start[860]: selecting default time zone ... UTC944gitlab # [ 9.775305] postgresql-pre-start[860]: creating configuration files ... ok945gitlab # [ 10.009509] gitlab-workhorse[891]: time="2026-09-03T10:13:12Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4946gitlab # [ 10.014829] gitlab-workhorse[891]: time="2026-09-03T10:13:12Z" level=info msg="Using redis/go-redis"947gitlab # [ 10.018908] gitlab-workhorse[891]: time="2026-09-03T10:13:12Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix948gitlab # [ 10.029267] postgresql-pre-start[860]: running bootstrap script ... ok949gitlab # [ 10.043673] dhcpcd[811]: eth0: soliciting a DHCP lease950gitlab # [ 10.056873] dhcpcd[811]: eth0: offered 10.0.2.15 from 10.0.2.2951gitlab # [ 10.076456] dhcpcd[811]: eth0: probing address 10.0.2.15/24952gitlab # [ 10.614899] postgresql-pre-start[860]: performing post-bootstrap initialization ... ok953gitlab # [ 10.838527] dhcpcd[811]: eth0: soliciting an IPv6 router954gitlab # [ 10.841827] dhcpcd[811]: eth0: Router Advertisement from fe80::2955gitlab # [ 10.845191] dhcpcd[811]: eth0: adding address fec0::5054:ff:fe12:3456/64956gitlab # [ 10.849068] dhcpcd[811]: eth0: adding route to fec0::/64957gitlab # [ 10.851953] dhcpcd[811]: eth0: adding default route via fe80::2958gitlab # [ 10.952359] postgresql-pre-start[860]: syncing data to disk ... ok959gitlab # [ 10.954991] postgresql-pre-start[860]: initdb: warning: enabling "trust" authentication for local connections960gitlab # [ 10.960277] postgresql-pre-start[860]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.961gitlab # [ 10.966593] postgresql-pre-start[860]: Success. You can now start the database server using:962gitlab # [ 10.970101] postgresql-pre-start[860]: pg_ctl -D /var/lib/postgresql/18 -l logfile start963gitlab # [ 11.141970] postgres[917]: [917] LOG: starting PostgreSQL 18.4 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit964gitlab # [ 11.147588] postgres[917]: [917] LOG: listening on IPv6 address "::1", port 5432965gitlab # [ 11.150940] postgres[917]: [917] LOG: listening on IPv4 address "127.0.0.1", port 5432966gitlab # [ 11.154591] postgres[917]: [917] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"967gitlab # [ 11.163681] postgres[926]: [926] LOG: database system was shut down at 2026-09-03 10:13:13 GMT968gitlab # [ 11.173725] postgres[917]: [917] LOG: database system is ready to accept connections969gitlab # [ 11.177038] systemd[1]: Started PostgreSQL Server.970gitlab # [ 11.182251] systemd[1]: Starting PostgreSQL Setup Scripts...971gitlab # [ 11.446691] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[934]: mkdir -p /var/gitlab/state/home/.ssh: OK972gitlab # [ 11.451366] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[934]: chmod 700 /var/gitlab/state/home/.ssh: OK973gitlab # [ 11.522022] postgresql-setup-start[942]: CREATE DATABASE974gitlab # [ 11.561188] systemd[1]: Finished gitlab-config.service.975gitlab # [ 11.565776] postgresql-setup-start[958]: CREATE ROLE976gitlab # [ 11.567105] systemd[1]: Started gitaly.service.977gitlab # [ 11.591736] postgresql-setup-start[962]: ALTER DATABASE978gitlab # [ 11.655817] postgresql-setup-start[968]: CREATE ROLE979gitlab # [ 11.662545] systemd[1]: Finished PostgreSQL Setup Scripts.980gitlab # [ 11.667691] systemd[1]: Reached target PostgreSQL.981gitlab # [ 11.672922] systemd[1]: Starting gitlab-db-config.service...982gitlab # [ 11.681228] systemd[1]: Starting gitlab-postgresql.service...983gitlab # [ 11.895759] gitlab-postgresql-start[987]: CREATE DATABASE984gitlab # [ 11.959288] gitlab-postgresql-start[997]: CREATE EXTENSION985gitlab # [ 12.045822] gitlab-postgresql-start[1001]: CREATE EXTENSION986gitlab # [ 12.051303] systemd[1]: Finished gitlab-postgresql.service.987gitlab # [ 12.569572] gitaly[961]: time="2026-09-03T10:13:15.439Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/0r0qd84zrxhqq373hk9spv8j9pg0qlnq-gitaly.toml' and fix the errors that are printed." pid=961988gitlab # [ 12.580652] gitaly[961]: time="2026-09-03T10:13:15.439Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=961989gitlab # [ 12.586601] gitaly[961]: time="2026-09-03T10:13:15.439Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=961990gitlab # [ 12.595766] gitaly[961]: time="2026-09-03T10:13:15.440Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=961991gitlab # [ 12.600678] gitaly[961]: time="2026-09-03T10:13:15.440Z" level=info msg="Starting Gitaly" pid=961 version=992gitlab # [ 12.845591] gitaly[961]: time="2026-09-03T10:13:15.716Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=275 pid=961993gitlab # [ 12.848842] gitaly[961]: time="2026-09-03T10:13:15.717Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=961994gitlab # [ 12.852003] gitaly[961]: time="2026-09-03T10:13:15.717Z" level=info msg="finished initializing command factory" duration_ms=0 pid=961995gitlab # [ 12.855258] gitaly[961]: time="2026-09-03T10:13:15.717Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-961/git-exec-2887874040.d/git pid=961996gitlab # [ 12.858677] gitaly[961]: time="2026-09-03T10:13:15.724Z" level=info msg="finished detecting git version" duration_ms=6 pid=961997gitlab # [ 12.861603] gitaly[961]: time="2026-09-03T10:13:15.724Z" level=info msg="using Git version" pid=961 version=2.53.g998gitlab # [ 12.864426] gitaly[961]: time="2026-09-03T10:13:15.724Z" level=info msg="clearing disk cache object folder" pid=961 storage=default999gitlab # [ 12.867270] gitaly[961]: time="2026-09-03T10:13:15.724Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache469520579 pid=961 storage=default1000gitlab # [ 12.872348] gitaly[961]: time="2026-09-03T10:13:15.725Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache469520579 pid=961 storage=default1001gitlab # [ 12.878070] gitaly[961]: time="2026-09-03T10:13:15.725Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=9611002gitlab # [ 12.882977] gitaly[961]: time="2026-09-03T10:13:15.725Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=9611003gitlab # [ 12.888149] gitaly[961]: time="2026-09-03T10:13:15.725Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache469520579 clear_duration_ms=0 pid=961 storage=default1004gitlab # [ 12.893316] gitaly[961]: time="2026-09-03T10:13:15.741Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=9611005gitlab # [ 12.897501] gitaly[961]: time="2026-09-03T10:13:15.742Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=961 schema=unix1006gitlab # [ 12.900557] gitaly[961]: time="2026-09-03T10:13:15.742Z" level=info msg="listening at address" address=/run/gitaly/gitaly-961/sock.d/intern pid=961 schema=unix1007gitlab # [ 12.904253] gitaly[961]: time="2026-09-03T10:13:15.742Z" level=info msg="counting repositories" pid=9611008gitlab # [ 12.906880] gitaly[961]: time="2026-09-03T10:13:15.742Z" level=info msg="starting to count repositories" pid=961 storage_path=/var/gitlab/state/repositories1009gitlab # [ 12.910928] gitaly[961]: time="2026-09-03T10:13:15.743Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=961 storage_path=/var/gitlab/state/repositories1010gitlab # [ 12.915620] gitaly[961]: time="2026-09-03T10:13:15.743Z" level=info msg="completed counting all repositories" counting_duration=0 pid=9611011gitlab # [ 12.919518] gitaly[961]: time="2026-09-03T10:13:15.743Z" level=info msg="finished tempdir cleaner walk" pid=961 storage=default time_ms=01012gitlab # [ 12.923165] gitaly[961]: time="2026-09-03T10:13:15.751Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9611013gitlab # [ 12.926561] gitaly[961]: time="2026-09-03T10:13:15.751Z" level=info msg="Started Gitaly" duration_ms=311 pid=9611014gitlab # [ 12.929538] gitaly[961]: time="2026-09-03T10:13:15.751Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9611015gitlab # [ 12.932827] gitaly[961]: time="2026-09-03T10:13:15.755Z" level=info msg="maintenance: daily scheduled" pid=961 scheduled="2026-09-03 12:00:00 +0000 UTC"1016gitlab # [ 13.104983] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[982]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1017gitlab # [ 13.115088] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[982]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1018gitlab # [ 13.125114] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[982]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1019gitlab # [ 15.486499] dhcpcd[811]: eth0: leased 10.0.2.15 for 86400 seconds1020gitlab # [ 15.486838] dhcpcd[811]: eth0: adding route to 10.0.2.0/241021gitlab # [ 15.487012] dhcpcd[811]: eth0: adding default route via 10.0.2.21022gitlab # [ 15.668691] systemd[1]: Started DHCP Client.1023gitlab # [ 15.670885] systemd[1]: Reached target Network is Online.1024gitlab # [ 16.279097] gitaly[961]: time="2026-09-03T10:13:19.148Z" level=info msg="License database preloaded" duration_ms=3708 pid=9611025gitlab # [ 58.836177] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[982]: W, [2026-09-03T10:14:01.705558 #982] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1026gitlab # [ 60.088879] gitlab-workhorse[891]: time="2026-09-03T10:14:02Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1027gitlab # [ 62.139703] postgres[1509]: [1509] ERROR: relation "feature_gates" does not exist at character 5231028gitlab # [ 62.140287] postgres[1509]: [1509] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1029gitlab # [ 62.140439] postgres[1509]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1030gitlab # [ 62.140546] postgres[1509]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1031gitlab # [ 62.140664] postgres[1509]: attidentity AS identity,1032gitlab # [ 62.140780] postgres[1509]: attgenerated as attgenerated1033gitlab # [ 62.140912] postgres[1509]: FROM pg_attribute a1034gitlab # [ 62.141031] postgres[1509]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1035gitlab # [ 62.141173] postgres[1509]: LEFT JOIN pg_type t ON a.atttypid = t.oid1036gitlab # [ 62.141292] postgres[1509]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1037gitlab # [ 62.141412] postgres[1509]: WHERE a.attrelid = '"feature_gates"'::regclass1038gitlab # [ 62.141530] postgres[1509]: AND a.attnum > 0 AND NOT a.attisdropped1039gitlab # [ 62.141632] postgres[1509]: ORDER BY a.attnum1040gitlab # [ 62.141748] postgres[1509]:1041gitlab # [ 67.464177] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1560]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1042gitlab # [ 67.464636] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1560]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1043gitlab # [ 70.098367] gitlab-workhorse[891]: time="2026-09-03T10:14:12Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1044gitlab # [ 80.108730] gitlab-workhorse[891]: time="2026-09-03T10:14:22Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1045gitlab # [ 90.118578] gitlab-workhorse[891]: time="2026-09-03T10:14:32Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1046gitlab # [ 95.177235] postgres[1663]: [1663] ERROR: relation "table_without_models" does not exist1047gitlab # [ 95.177643] postgres[1663]: [1663] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1048gitlab # [ 100.119776] gitlab-workhorse[891]: time="2026-09-03T10:14:42Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1049gitlab # [ 110.121045] gitlab-workhorse[891]: time="2026-09-03T10:14:52Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1050gitlab # [ 120.133284] gitlab-workhorse[891]: time="2026-09-03T10:15:03Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1051gitlab # [ 130.140003] gitlab-workhorse[891]: time="2026-09-03T10:15:13Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1052gitlab # [ 131.365780] systemd[1]: Finished gitlab-db-config.service.1053gitlab # [ 131.374487] systemd[1]: Started gitlab-sidekiq.service.1054gitlab # [ 131.381726] systemd[1]: Starting gitlab.service...1055gitlab # [ 131.983852] bundle[2093]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1056gitlab # [ 131.988104] bundle[2093]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1057gitlab # [ 131.990579] bundle[2093]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1058gitlab # [ 136.681661] bundle[2093]: {"timestamp":"2026-09-03T10:15:19.514Z","pid":2093,"message":"* Enabling systemd notification integration"}1059gitlab # [ 136.682088] bundle[2093]: {"timestamp":"2026-09-03T10:15:19.551Z","pid":2093,"message":"Puma starting in cluster mode..."}1060gitlab # [ 136.682231] bundle[2093]: {"timestamp":"2026-09-03T10:15:19.551Z","pid":2093,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1061gitlab # [ 136.682354] bundle[2093]: {"timestamp":"2026-09-03T10:15:19.551Z","pid":2093,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1062gitlab # [ 136.682471] bundle[2093]: {"timestamp":"2026-09-03T10:15:19.551Z","pid":2093,"message":"* Min threads: 0"}1063gitlab # [ 136.682609] bundle[2093]: {"timestamp":"2026-09-03T10:15:19.551Z","pid":2093,"message":"* Max threads: 4"}1064gitlab # [ 136.682766] bundle[2093]: {"timestamp":"2026-09-03T10:15:19.551Z","pid":2093,"message":"* Environment: production"}1065gitlab # [ 136.682902] bundle[2093]: {"timestamp":"2026-09-03T10:15:19.551Z","pid":2093,"message":"* Master PID: 2093"}1066gitlab # [ 136.683017] bundle[2093]: {"timestamp":"2026-09-03T10:15:19.551Z","pid":2093,"message":"* Workers: 2"}1067gitlab # [ 136.683137] bundle[2093]: {"timestamp":"2026-09-03T10:15:19.551Z","pid":2093,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1068gitlab # [ 136.683262] bundle[2093]: {"timestamp":"2026-09-03T10:15:19.551Z","pid":2093,"message":"* Preloading application"}1069gitlab # [ 136.685473] sidekiq-cluster[2092]: {"severity":"INFO","time":"2026-09-03T10:15:19.518Z","message":"Starting cluster with 1 processes"}1070gitlab # [ 140.140610] gitlab-workhorse[891]: time="2026-09-03T10:15:23Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1071gitlab # [ 150.151686] gitlab-workhorse[891]: time="2026-09-03T10:15:33Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1072gitlab # [ 160.162337] gitlab-workhorse[891]: time="2026-09-03T10:15:43Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1073gitlab # [ 170.173138] gitlab-workhorse[891]: time="2026-09-03T10:15:53Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1074gitlab # [ 176.501352] bundle[2093]: W, [2026-09-03T10:15:59.370866 #2093] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1075gitlab # [ 180.182201] gitlab-workhorse[891]: time="2026-09-03T10:16:03Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1076gitlab # [ 181.405253] sidekiq-cluster[2141]: 2026-09-03T10:16:04.274Z pid=2141 tid=xrp INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2141, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>425181184}1077gitlab # [ 182.026066] sidekiq-cluster[2141]: W, [2026-09-03T10:16:04.896685 #2141] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1078gitlab # [ 182.106007] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:04.976Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1079gitlab # [ 185.314238] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.183Z","message":"GitLab reliable fetch activated!"}1080gitlab # [ 185.319260] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.184Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1081gitlab # [ 185.348406] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.219Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1082gitlab # [ 185.355462] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.222Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1083gitlab # [ 185.362626] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.225Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1084gitlab # [ 185.369306] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.227Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1085gitlab # [ 185.376693] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.230Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1086gitlab # [ 185.383111] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.233Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1087gitlab # [ 185.389347] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.235Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1088gitlab # [ 185.394386] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.237Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1089gitlab # [ 185.399075] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.239Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1090gitlab # [ 185.403573] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.241Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1091gitlab # [ 185.408297] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.243Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1092gitlab # [ 185.412281] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.245Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1093gitlab # [ 185.415746] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.248Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1094gitlab # [ 185.419520] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.250Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1095gitlab # [ 185.423054] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.253Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1096gitlab # [ 185.426426] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.255Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1097gitlab # [ 185.429468] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.259Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1098gitlab # [ 185.432246] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.261Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1099gitlab # [ 185.435223] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.264Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1100gitlab # [ 185.438140] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.267Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1101gitlab # [ 185.441201] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.270Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1102gitlab # [ 185.444224] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.272Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1103gitlab # [ 185.446771] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.275Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1104gitlab # [ 185.449433] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.277Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1105gitlab # [ 185.451973] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.280Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1106gitlab # [ 185.454502] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.283Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1107gitlab # [ 185.456808] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.286Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1108gitlab # [ 185.459061] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.289Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1109gitlab # [ 185.461457] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.292Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1110gitlab # [ 185.463762] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.295Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1111gitlab # [ 185.466058] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.298Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1112gitlab # [ 185.468450] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.300Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1113gitlab # [ 185.470528] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.303Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1114gitlab # [ 185.472817] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.306Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1115gitlab # [ 185.474954] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.308Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1116gitlab # [ 185.477149] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.310Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1117gitlab # [ 185.479258] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.313Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1118gitlab # [ 185.481396] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.315Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1119gitlab # [ 185.483432] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.318Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1120gitlab # [ 185.485579] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.320Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1121gitlab # [ 185.487664] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.322Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1122gitlab # [ 185.489856] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.324Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1123gitlab # [ 185.491930] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.326Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1124gitlab # [ 185.494058] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.328Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1125gitlab # [ 185.496160] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.331Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1126gitlab # [ 185.498395] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.333Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1127gitlab # [ 185.500568] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.336Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1128gitlab # [ 185.502683] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.338Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1129gitlab # [ 185.504823] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.341Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1130gitlab # [ 185.506913] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.343Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1131gitlab # [ 185.509097] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.346Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1132gitlab # [ 185.511153] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.350Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1133gitlab # [ 185.513315] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.362Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1134gitlab # [ 185.515600] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.365Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1135gitlab # [ 185.517895] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.368Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1136gitlab # [ 185.520049] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.371Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1137gitlab # [ 185.522194] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.374Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1138gitlab # [ 185.524475] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.377Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1139gitlab # [ 185.526646] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.379Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1140gitlab # [ 185.586250] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.455Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1141gitlab # [ 185.589873] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.460Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1142gitlab # [ 185.593406] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.462Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1143gitlab # [ 185.597061] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.465Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1144gitlab # [ 185.600778] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.470Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1145gitlab # [ 185.604603] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.473Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1146gitlab # [ 185.608308] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.477Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1147gitlab # [ 185.611838] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.479Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1148gitlab # [ 185.615707] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.482Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1149gitlab # [ 185.619785] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.484Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1150gitlab # [ 185.623877] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.487Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1151gitlab # [ 185.627887] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.490Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1152gitlab # [ 185.631877] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.492Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1153gitlab # [ 185.635702] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.495Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1154gitlab # [ 185.639553] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.497Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1155gitlab # [ 185.643198] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.500Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1156gitlab # [ 185.646686] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.502Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1157gitlab # [ 185.649897] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.505Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1158gitlab # [ 185.653253] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.507Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1159gitlab # [ 185.656034] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.509Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1160gitlab # [ 185.658671] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.512Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1161gitlab # [ 185.661624] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.514Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1162gitlab # [ 185.664498] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.516Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1163gitlab # [ 185.667121] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.519Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1164gitlab # [ 185.669780] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.522Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1165gitlab # [ 185.672382] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.524Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1166gitlab # [ 185.674754] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.527Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1167gitlab # [ 185.677364] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.529Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1168gitlab # [ 185.679699] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.532Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1169gitlab # [ 185.682237] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.534Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1170gitlab # [ 185.684567] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.537Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1171gitlab # [ 185.686896] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.539Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1172gitlab # [ 185.689269] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.540Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1173gitlab # [ 185.691439] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.543Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1174gitlab # [ 185.693923] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.545Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1175gitlab # [ 185.695838] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.548Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1176gitlab # [ 185.698266] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.552Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1177gitlab # [ 185.700536] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.555Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1178gitlab # [ 185.702743] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.558Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1179gitlab # [ 185.705024] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.573Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1180gitlab # [ 185.707211] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.576Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1181gitlab # [ 185.709486] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.579Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1182gitlab # [ 185.712213] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.583Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1183gitlab # [ 185.715835] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.586Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1184gitlab # [ 185.718579] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.589Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1185gitlab # [ 185.721034] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.591Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1186gitlab # [ 185.724169] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.595Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1187gitlab # [ 185.726274] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.596Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1188gitlab # [ 185.729942] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.600Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1189gitlab # [ 185.733913] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:08.602Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1190gitlab # [ 190.190415] gitlab-workhorse[891]: time="2026-09-03T10:16:13Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1191gitlab # [ 200.192335] gitlab-workhorse[891]: time="2026-09-03T10:16:23Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1192gitlab # [ 210.195802] gitlab-workhorse[891]: time="2026-09-03T10:16:33Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1193gitlab # [ 220.202415] gitlab-workhorse[891]: time="2026-09-03T10:16:43Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1194gitlab # [ 225.456955] postgres[2887]: [2887] ERROR: relation "table_without_models" does not exist1195gitlab # [ 225.458474] postgres[2887]: [2887] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1196gitlab # [ 229.696408] postgres[2925]: [2925] ERROR: relation "table_without_models" does not exist1197gitlab # [ 229.696778] postgres[2925]: [2925] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1198gitlab # [ 230.208902] gitlab-workhorse[891]: time="2026-09-03T10:16:53Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1199gitlab # [ 230.377288] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:53.247Z","message":"Booted Rails 7.2.3.1 application in production environment"}1200gitlab # [ 230.384941] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:53.255Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1201gitlab # [ 230.387120] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:53.255Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1202gitlab # [ 230.389136] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:53.255Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1203gitlab # [ 230.391197] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:53.261Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1204gitlab # [ 233.139009] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:56.008Z","message":"Cleaning working queues"}1205gitlab # [ 233.143910] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:56.010Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"32c31d411633e408b8f0268c","created_at":"2026-09-03T10:15:13.723Z","trace_propagation_headers":{"sentry-trace":"9e7a9c1275e7408fbc90fd0ae747691d-4d940df9ec1a44b4","baggage":"sentry-trace_id=9e7a9c1275e7408fbc90fd0ae747691d,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"b3d7a987fc089e6a6986dddbc1545cc3","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:13.736Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-32c31d411633e408b8f0268c: start","job_status":"start","queue_duration_s":102.274516,"scheduling_latency_s":102.274571}1206gitlab # [ 233.411608] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:16:56.281Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"32c31d411633e408b8f0268c","created_at":"2026-09-03T10:15:13.723Z","trace_propagation_headers":{"sentry-trace":"9e7a9c1275e7408fbc90fd0ae747691d-4d940df9ec1a44b4","baggage":"sentry-trace_id=9e7a9c1275e7408fbc90fd0ae747691d,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"b3d7a987fc089e6a6986dddbc1545cc3","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-03T10:15:13.736Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-32c31d411633e408b8f0268c: done: 0.270353 sec","job_status":"done","queue_duration_s":102.274516,"scheduling_latency_s":102.274571,"redis_calls":29,"redis_duration_s":0.010439,"redis_read_bytes":282,"redis_write_bytes":3632,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.005771,"redis_feature_flag_read_bytes":272,"redis_feature_flag_write_bytes":2385,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002918,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00175,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":15,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.144637,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.14468626,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.270353,"completed_at":"2026-09-03T10:16:56.280Z","load_balancing_strategy":"primary","db_duration_s":0.079922,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1207gitlab # [ 237.018949] bundle[2093]: {"timestamp":"2026-09-03T10:16:59.888Z","pid":2093,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1208gitlab # [ 237.019298] bundle[2093]: {"timestamp":"2026-09-03T10:16:59.888Z","pid":2093,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1209gitlab # [ 237.019493] bundle[2093]: {"timestamp":"2026-09-03T10:16:59.888Z","pid":2093,"message":"! #\u003cThread:0x0000efcda7878bc8 /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1210gitlab # [ 237.019645] bundle[2093]: {"timestamp":"2026-09-03T10:16:59.888Z","pid":2093,"message":"! #\u003cThread:0x0000efcda7a67678 /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1211gitlab # [ 237.019813] bundle[2093]: {"timestamp":"2026-09-03T10:16:59.888Z","pid":2093,"message":"Use Ctrl-C to stop"}1212gitlab # [ 237.019936] bundle[2093]: {"timestamp":"2026-09-03T10:16:59.889Z","pid":2093,"message":"Sending status to systemd every 1.0 sec"}1213gitlab # [ 241.117969] bundle[2093]: {"timestamp":"2026-09-03T10:17:03.986Z","pid":2093,"message":"- Worker 1 (PID: 3047) booted in 4.04s, phase: 0"}1214gitlab # [ 241.120533] bundle[2093]: {"timestamp":"2026-09-03T10:17:03.986Z","pid":2093,"message":"- Worker 0 (PID: 3043) booted in 4.06s, phase: 0"}1215gitlab # [ 241.126207] systemd[1]: Started gitlab.service.1216gitlab # [ 241.131477] systemd[1]: Reached target Common target for all GitLab services..1217gitlab # [ 241.147613] systemd[1]: Starting setup-gitlab.service...1218gitlab # [ 241.193194] setup-gitlab-start[3109]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1219gitlab # [ 242.937458] gitlab-workhorse[891]: gitlab 2001:db8:1::1 - - [2026/09/03:10:17:05 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 16471220gitlab # [ 242.944553] setup-gitlab-start[3109]: + TOKEN=nixbot-test-token-of-20-chars1221gitlab # [ 242.945674] setup-gitlab-start[3109]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1222gitlab # [ 242.971435] runuser[3129]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1223gitlab # [ 243.595590] setup-gitlab-start[3130]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1224gitlab # [ 243.596077] setup-gitlab-start[3130]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1225gitlab # [ 243.597495] setup-gitlab-start[3130]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1226gitlab # [ 244.441225] setup-gitlab-start[3130]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1227gitlab # [ 244.441584] setup-gitlab-start[3130]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1228gitlab # [ 244.444111] setup-gitlab-start[3130]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1229gitlab # [ 248.046676] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:10.915Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"5a8c0fac17d016db1bc064dd","created_at":"2026-09-03T10:17:10.794Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"49b1e8f95b26fd579f3dbeb55efed017","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-03T10:17:10.910Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-5a8c0fac17d016db1bc064dd: start","job_status":"start","queue_duration_s":0.004942,"scheduling_latency_s":0.005021}1230gitlab # [ 248.561252] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:11.430Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"5a8c0fac17d016db1bc064dd","created_at":"2026-09-03T10:17:10.794Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"49b1e8f95b26fd579f3dbeb55efed017","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-03T10:17:10.910Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-5a8c0fac17d016db1bc064dd: done: 0.515226 sec","job_status":"done","queue_duration_s":0.004942,"scheduling_latency_s":0.005021,"redis_calls":14,"redis_duration_s":0.021287,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.005284,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007644,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.008359,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.038,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.034,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.18193,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00444436,"exclusive_lock_hold_duration_s":0.29964564,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.515226,"completed_at":"2026-09-03T10:17:11.430Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.080441,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1231gitlab # [ 248.666242] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:11.436Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"b2a03b0f9784ed9a15e4430f","created_at":"2026-09-03T10:17:10.930Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eebb9ce341a77c36174962fa64c5e15e","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-03T10:17:10.965Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-b2a03b0f9784ed9a15e4430f: start","job_status":"start","queue_duration_s":0.471418,"scheduling_latency_s":0.471474}1232gitlab # [ 249.525964] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:12.395Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"b2a03b0f9784ed9a15e4430f","created_at":"2026-09-03T10:17:10.930Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eebb9ce341a77c36174962fa64c5e15e","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-03T10:17:10.965Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-b2a03b0f9784ed9a15e4430f: done: 0.958861 sec","job_status":"done","queue_duration_s":0.471418,"scheduling_latency_s":0.471474,"redis_calls":565,"redis_duration_s":0.495143,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000666,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00167,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.492807,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.529641,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034736,"duration_s":0.958861,"completed_at":"2026-09-03T10:17:12.395Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000932,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1233gitlab # [ 249.526485] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:12.396Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"836cabac014eb259ac73f076","created_at":"2026-09-03T10:17:10.994Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"32b0668ae56ed13b7b98d7b78d7a0772","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-03T10:17:11.005Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-836cabac014eb259ac73f076: start","job_status":"start","queue_duration_s":1.391429,"scheduling_latency_s":1.391456}1234gitlab # [ 249.608033] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:12.410Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1235gitlab # [ 249.608138] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:12.418Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"836cabac014eb259ac73f076","created_at":"2026-09-03T10:17:10.994Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"32b0668ae56ed13b7b98d7b78d7a0772","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-03T10:17:11.005Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-836cabac014eb259ac73f076: done: 0.021732 sec","job_status":"done","queue_duration_s":1.391429,"scheduling_latency_s":1.391456,"redis_calls":10,"redis_duration_s":0.001412,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000286,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000789,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000337,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012876,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025638,"duration_s":0.021732,"completed_at":"2026-09-03T10:17:12.418Z","load_balancing_strategy":"primary","db_duration_s":0.000891,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1236gitlab # [ 250.326985] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:12.420Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"fc09a79558300b260bc9ffb9","created_at":"2026-09-03T10:17:11.029Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"81d246e0e998b245fa1153a34d04d1f2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-03T10:17:11.044Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-fc09a79558300b260bc9ffb9: start","job_status":"start","queue_duration_s":1.37528,"scheduling_latency_s":1.375301}1237gitlab # [ 250.327113] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:12.432Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1238gitlab # [ 250.327298] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:12.439Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"fc09a79558300b260bc9ffb9","created_at":"2026-09-03T10:17:11.029Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"81d246e0e998b245fa1153a34d04d1f2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-03T10:17:11.044Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-fc09a79558300b260bc9ffb9: done: 0.019334 sec","job_status":"done","queue_duration_s":1.37528,"scheduling_latency_s":1.375301,"redis_calls":10,"redis_duration_s":0.001347,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000277,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000778,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000292,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011541,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00044008,"duration_s":0.019334,"completed_at":"2026-09-03T10:17:12.439Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00062,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1239gitlab # [ 251.049048] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:12.441Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"af58191baffd0371937d9c33","created_at":"2026-09-03T10:17:11.085Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"73ffe30295d09f8f8f86af5378939ef0","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-03T10:17:11.156Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-af58191baffd0371937d9c33: start","job_status":"start","queue_duration_s":1.284418,"scheduling_latency_s":1.28444}1240gitlab # [ 251.049298] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:12.491Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"af58191baffd0371937d9c33","created_at":"2026-09-03T10:17:11.085Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"73ffe30295d09f8f8f86af5378939ef0","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-03T10:17:11.156Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-af58191baffd0371937d9c33: done: 0.05073 sec","job_status":"done","queue_duration_s":1.284418,"scheduling_latency_s":1.28444,"redis_calls":16,"redis_duration_s":0.002352,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001197,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000834,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000321,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023408,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002601,"duration_s":0.05073,"completed_at":"2026-09-03T10:17:12.491Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019646,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1241gitlab # [ 251.746638] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:12.493Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"85ce37ad5b1e5578086edb82","created_at":"2026-09-03T10:17:11.215Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a06c2db455ec47dbd50398d67fa064bc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-03T10:17:11.231Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-85ce37ad5b1e5578086edb82: start","job_status":"start","queue_duration_s":1.261336,"scheduling_latency_s":1.261354}1242gitlab # [ 252.468472] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:12.551Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"85ce37ad5b1e5578086edb82","created_at":"2026-09-03T10:17:11.215Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a06c2db455ec47dbd50398d67fa064bc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-03T10:17:11.231Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-85ce37ad5b1e5578086edb82: done: 0.058188 sec","job_status":"done","queue_duration_s":1.261336,"scheduling_latency_s":1.261354,"redis_calls":12,"redis_duration_s":0.002971,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000409,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001385,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001177,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022955,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00063958,"exclusive_lock_hold_duration_s":0.02698184,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.058188,"completed_at":"2026-09-03T10:17:12.551Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.026973,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1243gitlab # [ 253.199297] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:12.553Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"3c8f8d46c9dfe3b6d479beb1","created_at":"2026-09-03T10:17:11.249Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-03T10:17:11.260Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-3c8f8d46c9dfe3b6d479beb1: start","job_status":"start","queue_duration_s":1.292868,"scheduling_latency_s":1.292888}1244gitlab # [ 253.199577] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:12.668Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"3c8f8d46c9dfe3b6d479beb1","created_at":"2026-09-03T10:17:11.249Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-03T10:17:11.260Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-3c8f8d46c9dfe3b6d479beb1: done: 0.115074 sec","job_status":"done","queue_duration_s":1.292868,"scheduling_latency_s":1.292888,"redis_calls":71,"redis_duration_s":0.018073,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002392,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001067,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.013824,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00079,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.094639,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003549,"duration_s":0.115074,"completed_at":"2026-09-03T10:17:12.668Z","load_balancing_strategy":"primary","db_duration_s":0.002586,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1245gitlab # [ 253.925083] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:12.670Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"133070c67f33ddbed2b089a5","created_at":"2026-09-03T10:17:11.266Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5445b125923521f3c0093595a9795aa3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-03T10:17:11.276Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-133070c67f33ddbed2b089a5: start","job_status":"start","queue_duration_s":1.393706,"scheduling_latency_s":1.393725}1246gitlab # [ 253.925309] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:12.700Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"133070c67f33ddbed2b089a5","created_at":"2026-09-03T10:17:11.266Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5445b125923521f3c0093595a9795aa3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-03T10:17:11.276Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-133070c67f33ddbed2b089a5: done: 0.029982 sec","job_status":"done","queue_duration_s":1.393706,"scheduling_latency_s":1.393725,"redis_calls":12,"redis_duration_s":0.002864,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00046,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001365,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001039,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016296,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00056668,"exclusive_lock_hold_duration_s":0.00962092,"duration_s":0.029982,"completed_at":"2026-09-03T10:17:12.699Z","load_balancing_strategy":"primary","db_duration_s":0.005149,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1247gitlab # [ 254.662317] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:12.701Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"82cca48552d72b1ebc789858","created_at":"2026-09-03T10:17:11.282Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4d1dc619a8e0238a47cce4f132d0c9e3","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-03T10:17:11.292Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-82cca48552d72b1ebc789858: start","job_status":"start","queue_duration_s":1.409114,"scheduling_latency_s":1.409133}1248gitlab # [ 254.662601] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:12.736Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"82cca48552d72b1ebc789858","created_at":"2026-09-03T10:17:11.282Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4d1dc619a8e0238a47cce4f132d0c9e3","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-03T10:17:11.292Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-82cca48552d72b1ebc789858: done: 0.03432 sec","job_status":"done","queue_duration_s":1.409114,"scheduling_latency_s":1.409133,"redis_calls":13,"redis_duration_s":0.003224,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000479,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001649,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001096,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021801,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01154372,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.03432,"completed_at":"2026-09-03T10:17:12.735Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004492,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1249gitlab # [ 255.493124] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:12.737Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"f940cf4a2485c76c0759ccbb","created_at":"2026-09-03T10:17:11.301Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"df5a3d01a91b7ad7566fe0f066c442f3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-03T10:17:11.319Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-f940cf4a2485c76c0759ccbb: start","job_status":"start","queue_duration_s":1.417399,"scheduling_latency_s":1.417416}1250gitlab # [ 255.516102] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:12.749Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1251gitlab # [ 255.520506] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:12.756Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"f940cf4a2485c76c0759ccbb","created_at":"2026-09-03T10:17:11.301Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"df5a3d01a91b7ad7566fe0f066c442f3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-03T10:17:11.319Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-f940cf4a2485c76c0759ccbb: done: 0.019211 sec","job_status":"done","queue_duration_s":1.417399,"scheduling_latency_s":1.417416,"redis_calls":10,"redis_duration_s":0.002432,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000452,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001317,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000663,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010465,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032294,"duration_s":0.019211,"completed_at":"2026-09-03T10:17:12.756Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000509,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1252gitlab # [ 255.567523] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:12.758Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"9089d0df1986a68d905fc862","created_at":"2026-09-03T10:17:11.325Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8d98caf5b144be938315622cc80edebb","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-03T10:17:11.342Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-9089d0df1986a68d905fc862: start","job_status":"start","queue_duration_s":1.415545,"scheduling_latency_s":1.415562}1253gitlab # [ 255.581508] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:12.794Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"9089d0df1986a68d905fc862","created_at":"2026-09-03T10:17:11.325Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8d98caf5b144be938315622cc80edebb","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-03T10:17:11.342Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-9089d0df1986a68d905fc862: done: 0.03676 sec","job_status":"done","queue_duration_s":1.415545,"scheduling_latency_s":1.415562,"redis_calls":19,"redis_duration_s":0.004237,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000918,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.00033,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002291,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000698,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024693,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031562,"duration_s":0.03676,"completed_at":"2026-09-03T10:17:12.794Z","load_balancing_strategy":"primary","db_duration_s":0.003139,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1254gitlab # [ 255.624895] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:12.796Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"b454eef13abae154862e82e7","created_at":"2026-09-03T10:17:11.347Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"66a0b2420531471173bd6f2eb6268d18","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-03T10:17:11.362Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-b454eef13abae154862e82e7: start","job_status":"start","queue_duration_s":1.43466,"scheduling_latency_s":1.434678}1255gitlab # [ 255.639668] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:12.808Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1256gitlab # [ 255.643633] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:12.815Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"b454eef13abae154862e82e7","created_at":"2026-09-03T10:17:11.347Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"66a0b2420531471173bd6f2eb6268d18","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-03T10:17:11.362Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-b454eef13abae154862e82e7: done: 0.018765 sec","job_status":"done","queue_duration_s":1.43466,"scheduling_latency_s":1.434678,"redis_calls":10,"redis_duration_s":0.002277,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000454,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001357,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000466,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010455,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032978,"duration_s":0.018765,"completed_at":"2026-09-03T10:17:12.815Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00048,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1257gitlab # [ 255.688251] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:12.817Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"5e21f915df0e856e71f8587e","created_at":"2026-09-03T10:17:11.384Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f9d1a8ec531f0aca7edf4ab3e319ca55","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-03T10:17:11.400Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-5e21f915df0e856e71f8587e: start","job_status":"start","queue_duration_s":1.417088,"scheduling_latency_s":1.417104}1258gitlab # [ 255.701495] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:12.828Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1259gitlab # [ 255.705319] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:12.835Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"5e21f915df0e856e71f8587e","created_at":"2026-09-03T10:17:11.384Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f9d1a8ec531f0aca7edf4ab3e319ca55","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-03T10:17:11.400Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-5e21f915df0e856e71f8587e: done: 0.018505 sec","job_status":"done","queue_duration_s":1.417088,"scheduling_latency_s":1.417104,"redis_calls":10,"redis_duration_s":0.002255,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000451,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001331,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000473,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010284,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003657,"duration_s":0.018505,"completed_at":"2026-09-03T10:17:12.835Z","load_balancing_strategy":"primary","db_duration_s":0.000453,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1260gitlab # [ 255.747414] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:12.837Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"561f580a5302805357629ecc","created_at":"2026-09-03T10:17:11.421Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3d3acf85e4429b1b83245d1202f73a23","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-03T10:17:11.613Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-561f580a5302805357629ecc: start","job_status":"start","queue_duration_s":1.223416,"scheduling_latency_s":1.223433}1261gitlab # [ 255.761476] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:12.872Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"561f580a5302805357629ecc","created_at":"2026-09-03T10:17:11.421Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3d3acf85e4429b1b83245d1202f73a23","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-03T10:17:11.613Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-561f580a5302805357629ecc: done: 0.035482 sec","job_status":"done","queue_duration_s":1.223416,"scheduling_latency_s":1.223433,"redis_calls":10,"redis_duration_s":0.003071,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000456,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002056,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000559,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020489,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037956,"duration_s":0.035482,"completed_at":"2026-09-03T10:17:12.872Z","load_balancing_strategy":"primary","db_duration_s":0.007179,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1262gitlab # [ 255.804638] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:12.874Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"e247bd13c3123b92ecfc7f2b","created_at":"2026-09-03T10:17:11.681Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b6413e9b925b93434f5046d497401c96","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-03T10:17:11.703Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-e247bd13c3123b92ecfc7f2b: start","job_status":"start","queue_duration_s":1.170617,"scheduling_latency_s":1.170634}1263gitlab # [ 255.819990] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.160Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"e247bd13c3123b92ecfc7f2b","created_at":"2026-09-03T10:17:11.681Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b6413e9b925b93434f5046d497401c96","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-03T10:17:11.703Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-e247bd13c3123b92ecfc7f2b: done: 0.286436 sec","job_status":"done","queue_duration_s":1.170617,"scheduling_latency_s":1.170634,"redis_calls":12,"redis_duration_s":0.003743,"redis_read_bytes":11,"redis_write_bytes":1370,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000458,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001989,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001296,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.057,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.057,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.205038,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0005391,"exclusive_lock_hold_duration_s":0.25405826,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.286436,"completed_at":"2026-09-03T10:17:13.160Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.085204,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1264gitlab # [ 255.868541] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.164Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ArchiveTracesCronWorker","jid":"d5e7b61b2c4b6e86411c4718","created_at":"2026-09-03T10:17:11.729Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"30c30a2fb958962239a94afa7783ba9f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f0234f524ae629146c97646d3c809b290751f669b415a8b01cafe8f68b01506d","size_limiter":"validated","enqueued_at":"2026-09-03T10:17:11.751Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ArchiveTracesCronWorker JID-d5e7b61b2c4b6e86411c4718: start","job_status":"start","queue_duration_s":1.412816,"scheduling_latency_s":1.412865}1265gitlab # [ 255.907818] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.263Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ArchiveTracesCronWorker","jid":"d5e7b61b2c4b6e86411c4718","created_at":"2026-09-03T10:17:11.729Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"30c30a2fb958962239a94afa7783ba9f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f0234f524ae629146c97646d3c809b290751f669b415a8b01cafe8f68b01506d","size_limiter":"validated","enqueued_at":"2026-09-03T10:17:11.751Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ArchiveTracesCronWorker JID-d5e7b61b2c4b6e86411c4718: done: 0.099005 sec","job_status":"done","queue_duration_s":1.412816,"scheduling_latency_s":1.412865,"redis_calls":12,"redis_duration_s":0.005098,"redis_read_bytes":11,"redis_write_bytes":1354,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000639,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":297,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00272,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001739,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":519,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.018,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.057463,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0010502,"exclusive_lock_hold_duration_s":0.05046106,"duration_s":0.099005,"completed_at":"2026-09-03T10:17:13.263Z","load_balancing_strategy":"primary","db_duration_s":0.023366,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1266gitlab # [ 255.980585] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.267Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"9110c94fae38074a65bd4235","created_at":"2026-09-03T10:17:11.775Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"436c5dbedf1db65d6a478ab1ae61663d","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-03T10:17:11.797Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-9110c94fae38074a65bd4235: start","job_status":"start","queue_duration_s":1.46973,"scheduling_latency_s":1.469771}1267gitlab # [ 255.995641] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.354Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"9110c94fae38074a65bd4235","created_at":"2026-09-03T10:17:11.775Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"436c5dbedf1db65d6a478ab1ae61663d","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-03T10:17:11.797Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-9110c94fae38074a65bd4235: done: 0.087502 sec","job_status":"done","queue_duration_s":1.46973,"scheduling_latency_s":1.469771,"redis_calls":10,"redis_duration_s":0.004689,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000982,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002825,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000882,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040231,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00096214,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.087502,"completed_at":"2026-09-03T10:17:13.354Z","load_balancing_strategy":"primary","db_duration_s":0.028761,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1268gitlab # [ 256.038315] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.358Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"dca495b5b7e2a5b94f0792f0","created_at":"2026-09-03T10:17:11.849Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"591cd50c31e6c2be452c8f55ae6c34d9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-03T10:17:11.871Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-dca495b5b7e2a5b94f0792f0: start","job_status":"start","queue_duration_s":1.487254,"scheduling_latency_s":1.487305}1269gitlab # [ 256.054186] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.386Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1270gitlab # [ 256.057638] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.403Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"dca495b5b7e2a5b94f0792f0","created_at":"2026-09-03T10:17:11.849Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"591cd50c31e6c2be452c8f55ae6c34d9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-03T10:17:11.871Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-dca495b5b7e2a5b94f0792f0: done: 0.044741 sec","job_status":"done","queue_duration_s":1.487254,"scheduling_latency_s":1.487305,"redis_calls":10,"redis_duration_s":0.0035830000000000002,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000825,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002024,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000734,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026008,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00057994,"duration_s":0.044741,"completed_at":"2026-09-03T10:17:13.403Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000963,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1271gitlab # [ 256.104485] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.406Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"085f33cef38825bc9b18cf85","created_at":"2026-09-03T10:17:11.891Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4eef0d811c29fdd41b16afdd0595634d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-03T10:17:11.961Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-085f33cef38825bc9b18cf85: start","job_status":"start","queue_duration_s":1.444626,"scheduling_latency_s":1.444657}1272gitlab # [ 256.120317] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.570Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"085f33cef38825bc9b18cf85","created_at":"2026-09-03T10:17:11.891Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4eef0d811c29fdd41b16afdd0595634d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-03T10:17:11.961Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-085f33cef38825bc9b18cf85: done: 0.164754 sec","job_status":"done","queue_duration_s":1.444626,"scheduling_latency_s":1.444657,"redis_calls":12,"redis_duration_s":0.003224,"redis_read_bytes":11,"redis_write_bytes":1482,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00118,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001519,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000525,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013979,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00035388,"duration_s":0.164754,"completed_at":"2026-09-03T10:17:13.570Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001563,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1273gitlab # [ 256.163509] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.572Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"548b49eb57c6527dc730be22","created_at":"2026-09-03T10:17:12.008Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"76b54888874a525b72e498533441e076","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.029Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-548b49eb57c6527dc730be22: start","job_status":"start","queue_duration_s":1.542474,"scheduling_latency_s":1.542492}1274gitlab # [ 256.178355] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.592Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"548b49eb57c6527dc730be22","created_at":"2026-09-03T10:17:12.008Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"76b54888874a525b72e498533441e076","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.029Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-548b49eb57c6527dc730be22: done: 0.020419 sec","job_status":"done","queue_duration_s":1.542474,"scheduling_latency_s":1.542492,"redis_calls":10,"redis_duration_s":0.002486,"redis_read_bytes":9,"redis_write_bytes":1299,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000574,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001434,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000478,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01104,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037238,"duration_s":0.020419,"completed_at":"2026-09-03T10:17:13.592Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000711,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1275gitlab # [ 256.220447] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.594Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"cb5c2fb707ea992b69fe89b8","created_at":"2026-09-03T10:17:12.051Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a79ba70e583dc731f442abe716ce9b18","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.072Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-cb5c2fb707ea992b69fe89b8: start","job_status":"start","queue_duration_s":1.521387,"scheduling_latency_s":1.521404}1276gitlab # [ 256.234582] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.618Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"cb5c2fb707ea992b69fe89b8","created_at":"2026-09-03T10:17:12.051Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a79ba70e583dc731f442abe716ce9b18","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.072Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-cb5c2fb707ea992b69fe89b8: done: 0.024325 sec","job_status":"done","queue_duration_s":1.521387,"scheduling_latency_s":1.521404,"redis_calls":12,"redis_duration_s":0.0032319999999999996,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000606,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001401,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001225,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013203,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00061324,"exclusive_lock_hold_duration_s":0.00451788,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.024325,"completed_at":"2026-09-03T10:17:13.618Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0029,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1277gitlab # [ 256.287277] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.620Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"114c0605d7fd48acec473188","created_at":"2026-09-03T10:17:12.128Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"298f79d2bb9ac72793a59b85a5a7d3ae","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.147Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-114c0605d7fd48acec473188: start","job_status":"start","queue_duration_s":1.472976,"scheduling_latency_s":1.472993}1278gitlab # [ 256.301291] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.648Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"114c0605d7fd48acec473188","created_at":"2026-09-03T10:17:12.128Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"298f79d2bb9ac72793a59b85a5a7d3ae","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.147Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-114c0605d7fd48acec473188: done: 0.028446 sec","job_status":"done","queue_duration_s":1.472976,"scheduling_latency_s":1.472993,"redis_calls":10,"redis_duration_s":0.00266,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000585,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001532,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000543,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015947,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00035588,"duration_s":0.028446,"completed_at":"2026-09-03T10:17:13.648Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004863,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1279gitlab # [ 256.343110] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.650Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd7190aa8e3ef9a1270e0af9","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd7190aa8e3ef9a1270e0af9: start","job_status":"start","queue_duration_s":0.991355,"scheduling_latency_s":0.991372}1280gitlab # [ 256.355635] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.673Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd7190aa8e3ef9a1270e0af9","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd7190aa8e3ef9a1270e0af9: done: 0.023224 sec","job_status":"done","queue_duration_s":0.991355,"scheduling_latency_s":0.991372,"redis_calls":16,"redis_duration_s":0.00448,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000567,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001181,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002732,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013091,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003441,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023224,"completed_at":"2026-09-03T10:17:13.673Z","load_balancing_strategy":"primary","db_duration_s":0.000705,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1281gitlab # [ 256.396307] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.674Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af2d618e7549c8e34b2bfe5b","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af2d618e7549c8e34b2bfe5b: start","job_status":"start","queue_duration_s":1.016109,"scheduling_latency_s":1.016126}1282gitlab # [ 256.408517] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.690Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af2d618e7549c8e34b2bfe5b","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af2d618e7549c8e34b2bfe5b: done: 0.015506 sec","job_status":"done","queue_duration_s":1.016109,"scheduling_latency_s":1.016126,"redis_calls":13,"redis_duration_s":0.0026639999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000951,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001713,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009938,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015506,"completed_at":"2026-09-03T10:17:13.690Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1283gitlab # [ 256.451083] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.691Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4078afa331cd4f06807f9ea0","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4078afa331cd4f06807f9ea0: start","job_status":"start","queue_duration_s":1.033054,"scheduling_latency_s":1.033069}1284gitlab # [ 256.466025] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.706Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4078afa331cd4f06807f9ea0","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4078afa331cd4f06807f9ea0: done: 0.015078 sec","job_status":"done","queue_duration_s":1.033054,"scheduling_latency_s":1.033069,"redis_calls":13,"redis_duration_s":0.002709,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000931,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001778,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009055,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015078,"completed_at":"2026-09-03T10:17:13.706Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1285gitlab # [ 256.507447] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.708Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"79ea05252bf74ee815d953f5","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-79ea05252bf74ee815d953f5: start","job_status":"start","queue_duration_s":1.050064,"scheduling_latency_s":1.05008}1286gitlab # [ 256.521181] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.724Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"79ea05252bf74ee815d953f5","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-79ea05252bf74ee815d953f5: done: 0.015478 sec","job_status":"done","queue_duration_s":1.050064,"scheduling_latency_s":1.05008,"redis_calls":13,"redis_duration_s":0.0029389999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00096,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001979,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009502,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015478,"completed_at":"2026-09-03T10:17:13.724Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1287gitlab # [ 256.563187] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.725Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"75692eeb35c8986f5e721a6a","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-75692eeb35c8986f5e721a6a: start","job_status":"start","queue_duration_s":1.066973,"scheduling_latency_s":1.066989}1288gitlab # [ 256.576251] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.742Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"75692eeb35c8986f5e721a6a","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-75692eeb35c8986f5e721a6a: done: 0.01638 sec","job_status":"done","queue_duration_s":1.066973,"scheduling_latency_s":1.066989,"redis_calls":13,"redis_duration_s":0.002925,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001013,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001912,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010664,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01638,"completed_at":"2026-09-03T10:17:13.741Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1289gitlab # [ 256.616926] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.743Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c14eed1ae38f2b9741ab1ca6","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c14eed1ae38f2b9741ab1ca6: start","job_status":"start","queue_duration_s":1.084706,"scheduling_latency_s":1.084723}1290gitlab # [ 256.629798] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.760Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c14eed1ae38f2b9741ab1ca6","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c14eed1ae38f2b9741ab1ca6: done: 0.0172 sec","job_status":"done","queue_duration_s":1.084706,"scheduling_latency_s":1.084723,"redis_calls":13,"redis_duration_s":0.004136,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001938,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002198,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011233,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0172,"completed_at":"2026-09-03T10:17:13.760Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1291gitlab # [ 256.671139] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.761Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c0f8c48a6639795ce687774","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c0f8c48a6639795ce687774: start","job_status":"start","queue_duration_s":1.103284,"scheduling_latency_s":1.1033}1292gitlab # [ 256.683912] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.777Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c0f8c48a6639795ce687774","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c0f8c48a6639795ce687774: done: 0.015305 sec","job_status":"done","queue_duration_s":1.103284,"scheduling_latency_s":1.1033,"redis_calls":13,"redis_duration_s":0.002789,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000946,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001843,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009717,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015305,"completed_at":"2026-09-03T10:17:13.777Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1293gitlab # [ 256.724145] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.779Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0fe5be4343919f419857079d","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0fe5be4343919f419857079d: start","job_status":"start","queue_duration_s":1.120703,"scheduling_latency_s":1.12072}1294gitlab # [ 256.736935] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.805Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0fe5be4343919f419857079d","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0fe5be4343919f419857079d: done: 0.026508 sec","job_status":"done","queue_duration_s":1.120703,"scheduling_latency_s":1.12072,"redis_calls":13,"redis_duration_s":0.003778,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001545,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002233,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018408,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026508,"completed_at":"2026-09-03T10:17:13.805Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1295gitlab # [ 256.776843] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.809Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b6a4ec44eacf168833c9c88","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b6a4ec44eacf168833c9c88: start","job_status":"start","queue_duration_s":1.15094,"scheduling_latency_s":1.150985}1296gitlab # [ 256.789495] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.847Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b6a4ec44eacf168833c9c88","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b6a4ec44eacf168833c9c88: done: 0.037589 sec","job_status":"done","queue_duration_s":1.15094,"scheduling_latency_s":1.150985,"redis_calls":13,"redis_duration_s":0.003724,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001395,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002329,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026744,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.037589,"completed_at":"2026-09-03T10:17:13.847Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1297gitlab # [ 256.829501] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.849Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1cf0f789df05840f2f8fdfe6","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1cf0f789df05840f2f8fdfe6: start","job_status":"start","queue_duration_s":1.190727,"scheduling_latency_s":1.190759}1298gitlab # [ 256.842064] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.878Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1cf0f789df05840f2f8fdfe6","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1cf0f789df05840f2f8fdfe6: done: 0.029241 sec","job_status":"done","queue_duration_s":1.190727,"scheduling_latency_s":1.190759,"redis_calls":13,"redis_duration_s":0.003455,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00116,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002295,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019677,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029241,"completed_at":"2026-09-03T10:17:13.878Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1299gitlab # [ 256.882451] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.882Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d866c726874caa6750c220a","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d866c726874caa6750c220a: start","job_status":"start","queue_duration_s":1.223672,"scheduling_latency_s":1.223712}1300gitlab # [ 256.894984] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.906Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d866c726874caa6750c220a","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d866c726874caa6750c220a: done: 0.024032 sec","job_status":"done","queue_duration_s":1.223672,"scheduling_latency_s":1.223712,"redis_calls":13,"redis_duration_s":0.00327,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001115,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002155,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015334,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024032,"completed_at":"2026-09-03T10:17:13.906Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1301gitlab # [ 256.935457] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.908Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ebd12d468ea0f6ef9aa5816","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ebd12d468ea0f6ef9aa5816: start","job_status":"start","queue_duration_s":1.249456,"scheduling_latency_s":1.249477}1302gitlab # [ 256.948431] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.927Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ebd12d468ea0f6ef9aa5816","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ebd12d468ea0f6ef9aa5816: done: 0.019472 sec","job_status":"done","queue_duration_s":1.249456,"scheduling_latency_s":1.249477,"redis_calls":13,"redis_duration_s":0.003967,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001087,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00288,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012667,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019472,"completed_at":"2026-09-03T10:17:13.927Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1303gitlab # [ 256.988476] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.932Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8dd5439cd627ae663aa04db3","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8dd5439cd627ae663aa04db3: start","job_status":"start","queue_duration_s":1.273551,"scheduling_latency_s":1.27357}1304gitlab # [ 257.001089] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.950Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8dd5439cd627ae663aa04db3","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8dd5439cd627ae663aa04db3: done: 0.018052 sec","job_status":"done","queue_duration_s":1.273551,"scheduling_latency_s":1.27357,"redis_calls":13,"redis_duration_s":0.003003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001046,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001957,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011702,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018052,"completed_at":"2026-09-03T10:17:13.950Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1305gitlab # [ 257.041045] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.951Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9611a5650885998faa0089f3","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9611a5650885998faa0089f3: start","job_status":"start","queue_duration_s":1.293206,"scheduling_latency_s":1.293225}1306gitlab # [ 257.053796] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.970Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9611a5650885998faa0089f3","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9611a5650885998faa0089f3: done: 0.01831 sec","job_status":"done","queue_duration_s":1.293206,"scheduling_latency_s":1.293225,"redis_calls":13,"redis_duration_s":0.00292,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001041,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001879,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010837,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01831,"completed_at":"2026-09-03T10:17:13.970Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1307gitlab # [ 257.094656] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.972Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f68e82c22f5813dcc3a354dd","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f68e82c22f5813dcc3a354dd: start","job_status":"start","queue_duration_s":1.313916,"scheduling_latency_s":1.313934}1308gitlab # [ 257.107522] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.990Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f68e82c22f5813dcc3a354dd","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f68e82c22f5813dcc3a354dd: done: 0.018255 sec","job_status":"done","queue_duration_s":1.313916,"scheduling_latency_s":1.313934,"redis_calls":13,"redis_duration_s":0.0027489999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000993,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001756,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012151,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018255,"completed_at":"2026-09-03T10:17:13.990Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1309gitlab # [ 257.147437] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:13.992Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b0713ce4b36b2bfa2cd6fa7","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b0713ce4b36b2bfa2cd6fa7: start","job_status":"start","queue_duration_s":1.333536,"scheduling_latency_s":1.333554}1310gitlab # [ 257.160086] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.011Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b0713ce4b36b2bfa2cd6fa7","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b0713ce4b36b2bfa2cd6fa7: done: 0.018998 sec","job_status":"done","queue_duration_s":1.333536,"scheduling_latency_s":1.333554,"redis_calls":13,"redis_duration_s":0.003056,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000673,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002383,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013537,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018998,"completed_at":"2026-09-03T10:17:14.011Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1311gitlab # [ 257.200309] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.012Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d56888624f526ab3d3e216a4","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d56888624f526ab3d3e216a4: start","job_status":"start","queue_duration_s":1.354042,"scheduling_latency_s":1.354061}1312gitlab # [ 257.213196] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.034Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d56888624f526ab3d3e216a4","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d56888624f526ab3d3e216a4: done: 0.021649 sec","job_status":"done","queue_duration_s":1.354042,"scheduling_latency_s":1.354061,"redis_calls":13,"redis_duration_s":0.001786,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000696,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00109,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011212,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021649,"completed_at":"2026-09-03T10:17:14.034Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1313gitlab # [ 257.253542] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.036Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c07d5e33482a97004fc7739b","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c07d5e33482a97004fc7739b: start","job_status":"start","queue_duration_s":1.377471,"scheduling_latency_s":1.37749}1314gitlab # [ 257.266327] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.064Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c07d5e33482a97004fc7739b","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c07d5e33482a97004fc7739b: done: 0.028138 sec","job_status":"done","queue_duration_s":1.377471,"scheduling_latency_s":1.37749,"redis_calls":13,"redis_duration_s":0.003987,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00145,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002537,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019338,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028138,"completed_at":"2026-09-03T10:17:14.064Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1315gitlab # [ 257.307545] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.067Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"53193088051a0624fa2d9572","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-53193088051a0624fa2d9572: start","job_status":"start","queue_duration_s":1.408564,"scheduling_latency_s":1.40863}1316gitlab # [ 257.320220] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.097Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"53193088051a0624fa2d9572","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-53193088051a0624fa2d9572: done: 0.030509 sec","job_status":"done","queue_duration_s":1.408564,"scheduling_latency_s":1.40863,"redis_calls":13,"redis_duration_s":0.002793,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000958,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001835,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020655,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030509,"completed_at":"2026-09-03T10:17:14.097Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1317gitlab # [ 257.360449] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.099Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"86582b5eb3735f7dd0aea30f","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-86582b5eb3735f7dd0aea30f: start","job_status":"start","queue_duration_s":1.440943,"scheduling_latency_s":1.440967}1318gitlab # [ 257.373311] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.121Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"86582b5eb3735f7dd0aea30f","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-86582b5eb3735f7dd0aea30f: done: 0.022078 sec","job_status":"done","queue_duration_s":1.440943,"scheduling_latency_s":1.440967,"redis_calls":13,"redis_duration_s":0.0038520000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000998,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002854,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014873,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022078,"completed_at":"2026-09-03T10:17:14.121Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1319gitlab # [ 257.413699] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.123Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e9e2e4b45b9cecaf0fbc150","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e9e2e4b45b9cecaf0fbc150: start","job_status":"start","queue_duration_s":1.464667,"scheduling_latency_s":1.464688}1320gitlab # [ 257.426318] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.141Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e9e2e4b45b9cecaf0fbc150","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e9e2e4b45b9cecaf0fbc150: done: 0.018047 sec","job_status":"done","queue_duration_s":1.464667,"scheduling_latency_s":1.464688,"redis_calls":13,"redis_duration_s":0.002839,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000971,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001868,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011809,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018047,"completed_at":"2026-09-03T10:17:14.141Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1321gitlab # [ 257.466528] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.142Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"381061f304b6167af8aa774c","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-381061f304b6167af8aa774c: start","job_status":"start","queue_duration_s":1.48416,"scheduling_latency_s":1.484177}1322gitlab # [ 257.479274] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.172Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"381061f304b6167af8aa774c","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-381061f304b6167af8aa774c: done: 0.029708 sec","job_status":"done","queue_duration_s":1.48416,"scheduling_latency_s":1.484177,"redis_calls":13,"redis_duration_s":0.004811,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001297,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003514,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018711,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029708,"completed_at":"2026-09-03T10:17:14.172Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1323gitlab # [ 257.521357] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.175Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"403d6a3195c636e2269fa013","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-403d6a3195c636e2269fa013: start","job_status":"start","queue_duration_s":1.51699,"scheduling_latency_s":1.517029}1324gitlab # [ 257.534028] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.214Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"403d6a3195c636e2269fa013","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-403d6a3195c636e2269fa013: done: 0.03873 sec","job_status":"done","queue_duration_s":1.51699,"scheduling_latency_s":1.517029,"redis_calls":13,"redis_duration_s":0.00452,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003013,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02696,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03873,"completed_at":"2026-09-03T10:17:14.214Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1325gitlab # [ 257.574446] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.217Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39242bdd3d6ab27cbf27e419","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39242bdd3d6ab27cbf27e419: start","job_status":"start","queue_duration_s":1.558455,"scheduling_latency_s":1.558492}1326gitlab # [ 257.587146] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.256Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39242bdd3d6ab27cbf27e419","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39242bdd3d6ab27cbf27e419: done: 0.038957 sec","job_status":"done","queue_duration_s":1.558455,"scheduling_latency_s":1.558492,"redis_calls":13,"redis_duration_s":0.00519,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001617,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003573,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02748,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.038957,"completed_at":"2026-09-03T10:17:14.255Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1327gitlab # [ 257.627141] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.259Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8b857c56ca600649a9eed1a8","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8b857c56ca600649a9eed1a8: start","job_status":"start","queue_duration_s":1.600377,"scheduling_latency_s":1.600417}1328gitlab # [ 257.639939] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.294Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8b857c56ca600649a9eed1a8","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8b857c56ca600649a9eed1a8: done: 0.035917 sec","job_status":"done","queue_duration_s":1.600377,"scheduling_latency_s":1.600417,"redis_calls":13,"redis_duration_s":0.004182,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001384,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002798,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02328,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035917,"completed_at":"2026-09-03T10:17:14.294Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1329gitlab # [ 257.679773] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.298Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"feffb5b2e3a17ce9589b486b","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-feffb5b2e3a17ce9589b486b: start","job_status":"start","queue_duration_s":1.639738,"scheduling_latency_s":1.639772}1330gitlab # [ 257.693797] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.325Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"feffb5b2e3a17ce9589b486b","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-feffb5b2e3a17ce9589b486b: done: 0.02664 sec","job_status":"done","queue_duration_s":1.639738,"scheduling_latency_s":1.639772,"redis_calls":13,"redis_duration_s":0.003538,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001213,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002325,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017428,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02664,"completed_at":"2026-09-03T10:17:14.324Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1331gitlab # [ 257.734135] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.326Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce92be6dce3ff05787bc17cb","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce92be6dce3ff05787bc17cb: start","job_status":"start","queue_duration_s":1.668219,"scheduling_latency_s":1.668244}1332gitlab # [ 257.747056] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.348Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce92be6dce3ff05787bc17cb","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce92be6dce3ff05787bc17cb: done: 0.021169 sec","job_status":"done","queue_duration_s":1.668219,"scheduling_latency_s":1.668244,"redis_calls":13,"redis_duration_s":0.003086,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001129,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001957,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013944,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021169,"completed_at":"2026-09-03T10:17:14.347Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1333gitlab # [ 257.787116] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.349Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ebe5d2b506362a5d3acb444d","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ebe5d2b506362a5d3acb444d: start","job_status":"start","queue_duration_s":1.691041,"scheduling_latency_s":1.691064}1334gitlab # [ 257.800327] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.368Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ebe5d2b506362a5d3acb444d","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ebe5d2b506362a5d3acb444d: done: 0.018805 sec","job_status":"done","queue_duration_s":1.691041,"scheduling_latency_s":1.691064,"redis_calls":13,"redis_duration_s":0.003601,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001404,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002197,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011183,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018805,"completed_at":"2026-09-03T10:17:14.368Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1335gitlab # [ 257.840738] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.370Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ec18674168f18670098d3a9","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ec18674168f18670098d3a9: start","job_status":"start","queue_duration_s":1.711744,"scheduling_latency_s":1.711766}1336gitlab # [ 257.853443] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.388Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ec18674168f18670098d3a9","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ec18674168f18670098d3a9: done: 0.018262 sec","job_status":"done","queue_duration_s":1.711744,"scheduling_latency_s":1.711766,"redis_calls":13,"redis_duration_s":0.00296,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001003,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001957,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011406,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018262,"completed_at":"2026-09-03T10:17:14.388Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1337gitlab # [ 257.894477] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.390Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7492d7367be80dd7d5031213","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7492d7367be80dd7d5031213: start","job_status":"start","queue_duration_s":1.731733,"scheduling_latency_s":1.731757}1338gitlab # [ 257.907361] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.408Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7492d7367be80dd7d5031213","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7492d7367be80dd7d5031213: done: 0.018341 sec","job_status":"done","queue_duration_s":1.731733,"scheduling_latency_s":1.731757,"redis_calls":13,"redis_duration_s":0.0030229999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000988,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002035,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011669,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018341,"completed_at":"2026-09-03T10:17:14.408Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1339gitlab # [ 257.947422] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.410Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"668dbea7872722df0d5cb3d4","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-668dbea7872722df0d5cb3d4: start","job_status":"start","queue_duration_s":1.751599,"scheduling_latency_s":1.751617}1340gitlab # [ 257.960166] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.426Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"668dbea7872722df0d5cb3d4","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-668dbea7872722df0d5cb3d4: done: 0.016497 sec","job_status":"done","queue_duration_s":1.751599,"scheduling_latency_s":1.751617,"redis_calls":13,"redis_duration_s":0.00279,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000945,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001845,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010701,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016497,"completed_at":"2026-09-03T10:17:14.426Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1341gitlab # [ 257.999374] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.428Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"44651033cf92b2a416dbecc2","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-44651033cf92b2a416dbecc2: start","job_status":"start","queue_duration_s":1.769568,"scheduling_latency_s":1.769585}1342gitlab # [ 258.011869] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.443Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"44651033cf92b2a416dbecc2","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-44651033cf92b2a416dbecc2: done: 0.01522 sec","job_status":"done","queue_duration_s":1.769568,"scheduling_latency_s":1.769585,"redis_calls":13,"redis_duration_s":0.0028929999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000993,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0019,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009386,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01522,"completed_at":"2026-09-03T10:17:14.443Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1343gitlab # [ 258.051923] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.445Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf694b3f3fd91eb71e9a1f25","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf694b3f3fd91eb71e9a1f25: start","job_status":"start","queue_duration_s":1.786643,"scheduling_latency_s":1.786659}1344gitlab # [ 258.064706] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.461Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf694b3f3fd91eb71e9a1f25","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf694b3f3fd91eb71e9a1f25: done: 0.016194 sec","job_status":"done","queue_duration_s":1.786643,"scheduling_latency_s":1.786659,"redis_calls":13,"redis_duration_s":0.003261,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001004,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002257,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009953,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016194,"completed_at":"2026-09-03T10:17:14.461Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1345gitlab # [ 258.105283] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.463Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e9cb070c931b7d6addd10199","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e9cb070c931b7d6addd10199: start","job_status":"start","queue_duration_s":1.804919,"scheduling_latency_s":1.804966}1346gitlab # [ 258.117625] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.502Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e9cb070c931b7d6addd10199","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e9cb070c931b7d6addd10199: done: 0.038954 sec","job_status":"done","queue_duration_s":1.804919,"scheduling_latency_s":1.804966,"redis_calls":13,"redis_duration_s":0.0040999999999999995,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001473,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002627,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02643,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.038954,"completed_at":"2026-09-03T10:17:14.502Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1347gitlab # [ 258.156297] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.505Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0c4844190917a71c57a3d29","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0c4844190917a71c57a3d29: start","job_status":"start","queue_duration_s":1.846543,"scheduling_latency_s":1.846581}1348gitlab # [ 258.168401] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.535Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0c4844190917a71c57a3d29","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0c4844190917a71c57a3d29: done: 0.030406 sec","job_status":"done","queue_duration_s":1.846543,"scheduling_latency_s":1.846581,"redis_calls":13,"redis_duration_s":0.003095,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001092,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002003,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020545,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030406,"completed_at":"2026-09-03T10:17:14.535Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1349gitlab # [ 258.206906] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.537Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa4bf138b1465e472816dc21","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa4bf138b1465e472816dc21: start","job_status":"start","queue_duration_s":1.878876,"scheduling_latency_s":1.878903}1350gitlab # [ 258.219338] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.559Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa4bf138b1465e472816dc21","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa4bf138b1465e472816dc21: done: 0.022217 sec","job_status":"done","queue_duration_s":1.878876,"scheduling_latency_s":1.878903,"redis_calls":13,"redis_duration_s":0.003149,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002094,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013986,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022217,"completed_at":"2026-09-03T10:17:14.559Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1351gitlab # [ 258.258040] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.561Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e48c0a5ec39475a19d1b48d","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e48c0a5ec39475a19d1b48d: start","job_status":"start","queue_duration_s":1.90322,"scheduling_latency_s":1.903241}1352gitlab # [ 258.270294] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.580Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e48c0a5ec39475a19d1b48d","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e48c0a5ec39475a19d1b48d: done: 0.018502 sec","job_status":"done","queue_duration_s":1.90322,"scheduling_latency_s":1.903241,"redis_calls":13,"redis_duration_s":0.002992,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001008,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001984,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011653,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018502,"completed_at":"2026-09-03T10:17:14.580Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1353gitlab # [ 258.312645] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.582Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b07c030d074799b844ebd51","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b07c030d074799b844ebd51: start","job_status":"start","queue_duration_s":1.923458,"scheduling_latency_s":1.923477}1354gitlab # [ 258.325155] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.600Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b07c030d074799b844ebd51","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b07c030d074799b844ebd51: done: 0.018172 sec","job_status":"done","queue_duration_s":1.923458,"scheduling_latency_s":1.923477,"redis_calls":13,"redis_duration_s":0.0030039999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000992,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002012,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011422,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018172,"completed_at":"2026-09-03T10:17:14.600Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1355gitlab # [ 258.363919] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.602Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"61626fab01d1130084719fa4","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-61626fab01d1130084719fa4: start","job_status":"start","queue_duration_s":1.943411,"scheduling_latency_s":1.943431}1356gitlab # [ 258.376324] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.620Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"61626fab01d1130084719fa4","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-61626fab01d1130084719fa4: done: 0.018542 sec","job_status":"done","queue_duration_s":1.943411,"scheduling_latency_s":1.943431,"redis_calls":13,"redis_duration_s":0.002931,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000989,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001942,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011686,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018542,"completed_at":"2026-09-03T10:17:14.620Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1357gitlab # [ 258.414774] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.622Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28e6116062f92c5c989c89c4","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28e6116062f92c5c989c89c4: start","job_status":"start","queue_duration_s":1.963884,"scheduling_latency_s":1.963904}1358gitlab # [ 258.427113] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.639Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28e6116062f92c5c989c89c4","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28e6116062f92c5c989c89c4: done: 0.017293 sec","job_status":"done","queue_duration_s":1.963884,"scheduling_latency_s":1.963904,"redis_calls":13,"redis_duration_s":0.00289,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000964,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001926,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010042,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017293,"completed_at":"2026-09-03T10:17:14.639Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1359gitlab # [ 258.466069] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.641Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"79e094f22111a88637dce940","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-79e094f22111a88637dce940: start","job_status":"start","queue_duration_s":1.982576,"scheduling_latency_s":1.982592}1360gitlab # [ 258.478427] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.656Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"79e094f22111a88637dce940","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-79e094f22111a88637dce940: done: 0.015097 sec","job_status":"done","queue_duration_s":1.982576,"scheduling_latency_s":1.982592,"redis_calls":13,"redis_duration_s":0.0029649999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000936,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002029,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009381,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015097,"completed_at":"2026-09-03T10:17:14.656Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1361gitlab # [ 258.518088] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.657Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51e199bcf2073b851582346c","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51e199bcf2073b851582346c: start","job_status":"start","queue_duration_s":1.999041,"scheduling_latency_s":1.999056}1362gitlab # [ 258.531155] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.673Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51e199bcf2073b851582346c","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51e199bcf2073b851582346c: done: 0.015588 sec","job_status":"done","queue_duration_s":1.999041,"scheduling_latency_s":1.999056,"redis_calls":13,"redis_duration_s":0.002728,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000952,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001776,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009579,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015588,"completed_at":"2026-09-03T10:17:14.673Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1363gitlab # [ 258.571333] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.674Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0b0778ee1d97a2f137998373","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0b0778ee1d97a2f137998373: start","job_status":"start","queue_duration_s":2.016056,"scheduling_latency_s":2.016072}1364gitlab # [ 258.584042] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.689Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0b0778ee1d97a2f137998373","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0b0778ee1d97a2f137998373: done: 0.014939 sec","job_status":"done","queue_duration_s":2.016056,"scheduling_latency_s":2.016072,"redis_calls":13,"redis_duration_s":0.0028380000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000972,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001866,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009067,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014939,"completed_at":"2026-09-03T10:17:14.689Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1365gitlab # [ 258.624210] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.691Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a2b33a4bee8b2b4b8b910496","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a2b33a4bee8b2b4b8b910496: start","job_status":"start","queue_duration_s":2.032618,"scheduling_latency_s":2.032634}1366gitlab # [ 258.636764] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.706Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a2b33a4bee8b2b4b8b910496","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a2b33a4bee8b2b4b8b910496: done: 0.015066 sec","job_status":"done","queue_duration_s":2.032618,"scheduling_latency_s":2.032634,"redis_calls":13,"redis_duration_s":0.0026939999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000935,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001759,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009488,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015066,"completed_at":"2026-09-03T10:17:14.706Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1367gitlab # [ 258.676888] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.707Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"44694081bbe62ea6965f8199","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-44694081bbe62ea6965f8199: start","job_status":"start","queue_duration_s":2.049132,"scheduling_latency_s":2.049148}1368gitlab # [ 258.689539] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.722Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"44694081bbe62ea6965f8199","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-44694081bbe62ea6965f8199: done: 0.01497 sec","job_status":"done","queue_duration_s":2.049132,"scheduling_latency_s":2.049148,"redis_calls":13,"redis_duration_s":0.002685,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000907,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001778,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009427,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01497,"completed_at":"2026-09-03T10:17:14.722Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1369gitlab # [ 258.730349] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.724Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8091368f4f63d8e5392ce90","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8091368f4f63d8e5392ce90: start","job_status":"start","queue_duration_s":2.065794,"scheduling_latency_s":2.065811}1370gitlab # [ 258.743236] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.740Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8091368f4f63d8e5392ce90","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8091368f4f63d8e5392ce90: done: 0.015913 sec","job_status":"done","queue_duration_s":2.065794,"scheduling_latency_s":2.065811,"redis_calls":13,"redis_duration_s":0.002649,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000908,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001741,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010026,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015913,"completed_at":"2026-09-03T10:17:14.740Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1371gitlab # [ 258.783713] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.742Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d2e393ca363876a1a320ad6","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d2e393ca363876a1a320ad6: start","job_status":"start","queue_duration_s":2.083445,"scheduling_latency_s":2.083462}1372gitlab # [ 258.796804] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.758Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d2e393ca363876a1a320ad6","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d2e393ca363876a1a320ad6: done: 0.016164 sec","job_status":"done","queue_duration_s":2.083445,"scheduling_latency_s":2.083462,"redis_calls":13,"redis_duration_s":0.002774,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000954,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00182,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010456,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016164,"completed_at":"2026-09-03T10:17:14.758Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1373gitlab # [ 258.837645] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.760Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"62d398fd29ef1309b87652a0","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-62d398fd29ef1309b87652a0: start","job_status":"start","queue_duration_s":2.101822,"scheduling_latency_s":2.10184}1374gitlab # [ 258.850195] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.776Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"62d398fd29ef1309b87652a0","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-62d398fd29ef1309b87652a0: done: 0.016106 sec","job_status":"done","queue_duration_s":2.101822,"scheduling_latency_s":2.10184,"redis_calls":13,"redis_duration_s":0.002773,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000914,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001859,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010473,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016106,"completed_at":"2026-09-03T10:17:14.776Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1375gitlab # [ 258.888852] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.778Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc7f18f46120b58022b543d3","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc7f18f46120b58022b543d3: start","job_status":"start","queue_duration_s":2.119589,"scheduling_latency_s":2.119605}1376gitlab # [ 258.901248] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.794Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc7f18f46120b58022b543d3","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc7f18f46120b58022b543d3: done: 0.01581 sec","job_status":"done","queue_duration_s":2.119589,"scheduling_latency_s":2.119605,"redis_calls":13,"redis_duration_s":0.002759,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00093,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001829,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010173,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01581,"completed_at":"2026-09-03T10:17:14.794Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1377gitlab # [ 258.941378] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.795Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f23a15df9f863a35e1cc508f","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f23a15df9f863a35e1cc508f: start","job_status":"start","queue_duration_s":2.137126,"scheduling_latency_s":2.137144}1378gitlab # [ 258.953672] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.812Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f23a15df9f863a35e1cc508f","created_at":"2026-09-03T10:17:12.576Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-9cc25ea1e50e4fe2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d37fd94311cb756057af03d524b2561b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.658Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f23a15df9f863a35e1cc508f: done: 0.016224 sec","job_status":"done","queue_duration_s":2.137126,"scheduling_latency_s":2.137144,"redis_calls":13,"redis_duration_s":0.0032110000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001268,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001943,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010396,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016224,"completed_at":"2026-09-03T10:17:14.811Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1379gitlab # [ 258.992903] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.813Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"35c20b716b2138a10ffb14d4","created_at":"2026-09-03T10:17:12.774Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-444dbd3278644491","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8d98caf5b144be938315622cc80edebb","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.787Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-35c20b716b2138a10ffb14d4: start","job_status":"start","queue_duration_s":2.026047,"scheduling_latency_s":2.026063}1380gitlab # [ 259.005076] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.833Z","message":"No existing merge request to be cleaned up."}1381gitlab # [ 259.007017] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.850Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"35c20b716b2138a10ffb14d4","created_at":"2026-09-03T10:17:12.774Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-444dbd3278644491","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8d98caf5b144be938315622cc80edebb","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.787Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-35c20b716b2138a10ffb14d4: done: 0.036678 sec","job_status":"done","queue_duration_s":2.026047,"scheduling_latency_s":2.026063,"redis_calls":13,"redis_duration_s":0.0035440000000000003,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000586,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001278,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00168,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021174,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037462,"duration_s":0.036678,"completed_at":"2026-09-03T10:17:14.850Z","load_balancing_strategy":"primary","db_duration_s":0.006653,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1382gitlab # [ 259.047332] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.851Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"47f265794fd07e2aa943baaf","created_at":"2026-09-03T10:17:12.774Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-444dbd3278644491","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8d98caf5b144be938315622cc80edebb","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.787Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-47f265794fd07e2aa943baaf: start","job_status":"start","queue_duration_s":2.064566,"scheduling_latency_s":2.064582}1383gitlab # [ 259.059489] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.863Z","message":"No existing merge request to be cleaned up."}1384gitlab # [ 259.061255] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.873Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"47f265794fd07e2aa943baaf","created_at":"2026-09-03T10:17:12.774Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-444dbd3278644491","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8d98caf5b144be938315622cc80edebb","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.787Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-47f265794fd07e2aa943baaf: done: 0.021752 sec","job_status":"done","queue_duration_s":2.064566,"scheduling_latency_s":2.064582,"redis_calls":10,"redis_duration_s":0.002538,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001058,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00148,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013669,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021752,"completed_at":"2026-09-03T10:17:14.873Z","load_balancing_strategy":"primary","db_duration_s":0.002658,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1385gitlab # [ 259.099460] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.875Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"201e45b4bb9e3656ae9b0354","created_at":"2026-09-03T10:17:12.774Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-444dbd3278644491","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8d98caf5b144be938315622cc80edebb","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.787Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-201e45b4bb9e3656ae9b0354: start","job_status":"start","queue_duration_s":2.087801,"scheduling_latency_s":2.087818}1386gitlab # [ 259.112058] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.898Z","message":"No existing merge request to be cleaned up."}1387gitlab # [ 259.114778] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.920Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"201e45b4bb9e3656ae9b0354","created_at":"2026-09-03T10:17:12.774Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-444dbd3278644491","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8d98caf5b144be938315622cc80edebb","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.787Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-201e45b4bb9e3656ae9b0354: done: 0.045466 sec","job_status":"done","queue_duration_s":2.087801,"scheduling_latency_s":2.087818,"redis_calls":10,"redis_duration_s":0.004602,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001997,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002605,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035527,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.045466,"completed_at":"2026-09-03T10:17:14.920Z","load_balancing_strategy":"primary","db_duration_s":0.004188,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1388gitlab # [ 259.153317] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.923Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0c190b09cfa5369fe7135d18","created_at":"2026-09-03T10:17:12.774Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-444dbd3278644491","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8d98caf5b144be938315622cc80edebb","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.787Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0c190b09cfa5369fe7135d18: start","job_status":"start","queue_duration_s":2.136061,"scheduling_latency_s":2.136104}1389gitlab # [ 259.165542] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.948Z","message":"No existing merge request to be cleaned up."}1390gitlab # [ 259.167222] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:17:14.965Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0c190b09cfa5369fe7135d18","created_at":"2026-09-03T10:17:12.774Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-444dbd3278644491","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8d98caf5b144be938315622cc80edebb","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:17:12.787Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0c190b09cfa5369fe7135d18: done: 0.041734 sec","job_status":"done","queue_duration_s":2.136061,"scheduling_latency_s":2.136104,"redis_calls":10,"redis_duration_s":0.0036520000000000003,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001262,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00239,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028976,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.041734,"completed_at":"2026-09-03T10:17:14.965Z","load_balancing_strategy":"primary","db_duration_s":0.003499,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1391gitlab # [ 285.713662] setup-gitlab-start[3130]: W, [2026-09-03T10:17:48.583320 #3130] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1392gitlab # [ 298.293845] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:01.162Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"f1ac00d485197e2944ae7acf","created_at":"2026-09-03T10:18:01.140Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"928a3bbeee8f9b2db98c1ef45b428f96","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-03T10:18:01.159Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-f1ac00d485197e2944ae7acf: start","job_status":"start","queue_duration_s":0.003414,"scheduling_latency_s":0.003471}1393gitlab # [ 298.597659] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:01.466Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"f1ac00d485197e2944ae7acf","created_at":"2026-09-03T10:18:01.140Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"928a3bbeee8f9b2db98c1ef45b428f96","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-03T10:18:01.159Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-f1ac00d485197e2944ae7acf: done: 0.304382 sec","job_status":"done","queue_duration_s":0.003414,"scheduling_latency_s":0.003471,"redis_calls":16,"redis_duration_s":0.065288,"redis_read_bytes":903,"redis_write_bytes":1626,"redis_feature_flag_calls":7,"redis_feature_flag_duration_s":0.04829,"redis_feature_flag_read_bytes":896,"redis_feature_flag_write_bytes":464,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.008106,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.008892,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.075,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.075,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.074145,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00683732,"exclusive_lock_hold_duration_s":0.1621565,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.304382,"completed_at":"2026-09-03T10:18:01.466Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.166883,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1394gitlab # [ 298.693226] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:01.478Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"8cc0c158c4f2000d99619975","created_at":"2026-09-03T10:18:01.183Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a09c7adf0ec7543d17846eb6b7edb416","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-03T10:18:01.197Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-8cc0c158c4f2000d99619975: start","job_status":"start","queue_duration_s":0.281657,"scheduling_latency_s":0.281715}1395gitlab # [ 299.742885] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:02.612Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"8cc0c158c4f2000d99619975","created_at":"2026-09-03T10:18:01.183Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a09c7adf0ec7543d17846eb6b7edb416","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-03T10:18:01.197Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-8cc0c158c4f2000d99619975: done: 1.133533 sec","job_status":"done","queue_duration_s":0.281657,"scheduling_latency_s":0.281715,"redis_calls":562,"redis_duration_s":0.599626,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004791,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.594835,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.602903,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":1.133533,"completed_at":"2026-09-03T10:18:02.612Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1396gitlab # [ 299.748630] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:02.613Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"490d7393015a222a2ed7fee1","created_at":"2026-09-03T10:18:01.237Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"60693fa51cb53dd5778bf3fca86e3982","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-03T10:18:01.247Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-490d7393015a222a2ed7fee1: start","job_status":"start","queue_duration_s":1.366648,"scheduling_latency_s":1.366679}1397gitlab # [ 299.815826] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:02.623Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1398gitlab # [ 299.815968] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:02.629Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"490d7393015a222a2ed7fee1","created_at":"2026-09-03T10:18:01.237Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"60693fa51cb53dd5778bf3fca86e3982","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-03T10:18:01.247Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-490d7393015a222a2ed7fee1: done: 0.015375 sec","job_status":"done","queue_duration_s":1.366648,"scheduling_latency_s":1.366679,"redis_calls":7,"redis_duration_s":0.001026,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000717,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000309,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008904,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015375,"completed_at":"2026-09-03T10:18:02.629Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1399gitlab # [ 299.893763] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:02.630Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"44f4b122d68bea2decd5fde8","created_at":"2026-09-03T10:18:01.272Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4cb0857ca1661d69b27b56817f700a3e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-03T10:18:01.279Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-44f4b122d68bea2decd5fde8: start","job_status":"start","queue_duration_s":1.351279,"scheduling_latency_s":1.351298}1400gitlab # [ 299.910924] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:02.639Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1401gitlab # [ 299.915299] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:02.644Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"44f4b122d68bea2decd5fde8","created_at":"2026-09-03T10:18:01.272Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4cb0857ca1661d69b27b56817f700a3e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-03T10:18:01.279Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-44f4b122d68bea2decd5fde8: done: 0.014225 sec","job_status":"done","queue_duration_s":1.351279,"scheduling_latency_s":1.351298,"redis_calls":7,"redis_duration_s":0.0010010000000000002,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000719,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000282,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008499,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014225,"completed_at":"2026-09-03T10:18:02.644Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1402gitlab # [ 299.958570] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:02.646Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"491c0cba3ce546a452b69792","created_at":"2026-09-03T10:18:01.292Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"296d17eeb37894d396bb3c1b6586ca5c","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-03T10:18:01.332Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-491c0cba3ce546a452b69792: start","job_status":"start","queue_duration_s":1.313982,"scheduling_latency_s":1.314002}1403gitlab # [ 299.973255] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:02.711Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"491c0cba3ce546a452b69792","created_at":"2026-09-03T10:18:01.292Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"296d17eeb37894d396bb3c1b6586ca5c","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-03T10:18:01.332Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-491c0cba3ce546a452b69792: done: 0.06435 sec","job_status":"done","queue_duration_s":1.313982,"scheduling_latency_s":1.314002,"redis_calls":13,"redis_duration_s":0.002349,"redis_read_bytes":139,"redis_write_bytes":1611,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000543,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":386,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000814,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000992,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.032,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.032,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019468,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00072072,"exclusive_lock_hold_duration_s":0.01133328,"duration_s":0.06435,"completed_at":"2026-09-03T10:18:02.711Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.037148,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404gitlab # [ 300.015771] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:02.712Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"b1e3a024fb687f189ce4d822","created_at":"2026-09-03T10:18:01.351Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"923692ef87e24f28f6f7f3d1774c05be","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-03T10:18:01.357Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-b1e3a024fb687f189ce4d822: start","job_status":"start","queue_duration_s":1.355031,"scheduling_latency_s":1.355051}1405gitlab # [ 300.030268] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:02.755Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"b1e3a024fb687f189ce4d822","created_at":"2026-09-03T10:18:01.351Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"923692ef87e24f28f6f7f3d1774c05be","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-03T10:18:01.357Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-b1e3a024fb687f189ce4d822: done: 0.042781 sec","job_status":"done","queue_duration_s":1.355031,"scheduling_latency_s":1.355051,"redis_calls":7,"redis_duration_s":0.002085,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001308,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000777,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019758,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.042781,"completed_at":"2026-09-03T10:18:02.755Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015543,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1406gitlab # [ 300.070808] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:02.759Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"6cc697ea230ed0816b81f737","created_at":"2026-09-03T10:18:01.384Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fe3a9486b43a6f4028ad9a4404536075","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-09-03T10:18:01.405Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-6cc697ea230ed0816b81f737: start","job_status":"start","queue_duration_s":1.353797,"scheduling_latency_s":1.353842}1407gitlab # [ 300.085640] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:02.807Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"6cc697ea230ed0816b81f737","created_at":"2026-09-03T10:18:01.384Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fe3a9486b43a6f4028ad9a4404536075","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-09-03T10:18:01.405Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-6cc697ea230ed0816b81f737: done: 0.048517 sec","job_status":"done","queue_duration_s":1.353797,"scheduling_latency_s":1.353842,"redis_calls":12,"redis_duration_s":0.006204,"redis_read_bytes":11,"redis_write_bytes":1247,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001945,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00222,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002039,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":296,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029004,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00058942,"extra.object_storage_delete_stale_direct_uploads_worker.total_pending_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.total_deleted_stale_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.execution_timeout":false,"duration_s":0.048517,"completed_at":"2026-09-03T10:18:02.807Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000967,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1408gitlab # [ 300.130739] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:02.810Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"d8ef0aabb0687524ea393801","created_at":"2026-09-03T10:18:01.430Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1ca42e531d947726e1da50d9c1407757","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-03T10:18:01.447Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-d8ef0aabb0687524ea393801: start","job_status":"start","queue_duration_s":1.363085,"scheduling_latency_s":1.36312}1409gitlab # [ 300.145717] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:02.848Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"d8ef0aabb0687524ea393801","created_at":"2026-09-03T10:18:01.430Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1ca42e531d947726e1da50d9c1407757","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-03T10:18:01.447Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-d8ef0aabb0687524ea393801: done: 0.038694 sec","job_status":"done","queue_duration_s":1.363085,"scheduling_latency_s":1.36312,"redis_calls":12,"redis_duration_s":0.004934,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000977,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000819,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002504,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000634,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023969,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00049506,"duration_s":0.038694,"completed_at":"2026-09-03T10:18:02.848Z","load_balancing_strategy":"primary","db_duration_s":0.000863,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1410gitlab # [ 300.188308] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:02.851Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"7ee6ec8e8c23379ca54f089d","created_at":"2026-09-03T10:18:01.464Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"91ccb10a21690abba844433c9d3be763","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-03T10:18:01.473Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-7ee6ec8e8c23379ca54f089d: start","job_status":"start","queue_duration_s":1.377649,"scheduling_latency_s":1.37768}1411gitlab # [ 300.203391] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:02.922Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"7ee6ec8e8c23379ca54f089d","created_at":"2026-09-03T10:18:01.464Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"91ccb10a21690abba844433c9d3be763","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-03T10:18:01.473Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-7ee6ec8e8c23379ca54f089d: done: 0.071261 sec","job_status":"done","queue_duration_s":1.377649,"scheduling_latency_s":1.37768,"redis_calls":9,"redis_duration_s":0.003589,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001816,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001773,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041731,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00147882,"exclusive_lock_hold_duration_s":0.02845394,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.071261,"completed_at":"2026-09-03T10:18:02.922Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.020491,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1412gitlab # [ 300.246050] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:02.926Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"f185e171889132b88e7385a0","created_at":"2026-09-03T10:18:01.501Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-03T10:18:01.515Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-f185e171889132b88e7385a0: start","job_status":"start","queue_duration_s":1.41122,"scheduling_latency_s":1.411269}1413gitlab # [ 300.259587] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.101Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"f185e171889132b88e7385a0","created_at":"2026-09-03T10:18:01.501Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-03T10:18:01.515Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-f185e171889132b88e7385a0: done: 0.175254 sec","job_status":"done","queue_duration_s":1.41122,"scheduling_latency_s":1.411269,"redis_calls":60,"redis_duration_s":0.018291,"redis_read_bytes":108,"redis_write_bytes":41059,"redis_queues_calls":2,"redis_queues_duration_s":0.001012,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.016348,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000931,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.157793,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.175254,"completed_at":"2026-09-03T10:18:03.101Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1414gitlab # [ 300.299584] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.103Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"62190a35c0cb5568cc6bce68","created_at":"2026-09-03T10:18:01.538Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d23d434d87667d43ad9fba228842b58f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-03T10:18:01.548Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-62190a35c0cb5568cc6bce68: start","job_status":"start","queue_duration_s":1.555404,"scheduling_latency_s":1.555438}1415gitlab # [ 300.312960] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.129Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"62190a35c0cb5568cc6bce68","created_at":"2026-09-03T10:18:01.538Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d23d434d87667d43ad9fba228842b58f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-03T10:18:01.548Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-62190a35c0cb5568cc6bce68: done: 0.025678 sec","job_status":"done","queue_duration_s":1.555404,"scheduling_latency_s":1.555438,"redis_calls":9,"redis_duration_s":0.003136,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001847,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001289,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016784,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00075264,"exclusive_lock_hold_duration_s":0.00565146,"duration_s":0.025678,"completed_at":"2026-09-03T10:18:03.129Z","load_balancing_strategy":"primary","db_duration_s":0.00152,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1416gitlab # [ 300.354139] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.131Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"00e04d2a708b7a0f5d479766","created_at":"2026-09-03T10:18:01.569Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"347717cbe4483fb731bdbf6d937b51d9","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-03T10:18:01.584Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-00e04d2a708b7a0f5d479766: start","job_status":"start","queue_duration_s":1.546748,"scheduling_latency_s":1.546782}1417gitlab # [ 300.368716] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.169Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"00e04d2a708b7a0f5d479766","created_at":"2026-09-03T10:18:01.569Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"347717cbe4483fb731bdbf6d937b51d9","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-03T10:18:01.584Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-00e04d2a708b7a0f5d479766: done: 0.038401 sec","job_status":"done","queue_duration_s":1.546748,"scheduling_latency_s":1.546782,"redis_calls":10,"redis_duration_s":0.003582,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002138,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001444,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027103,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00950804,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.038401,"completed_at":"2026-09-03T10:18:03.169Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003153,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1418gitlab # [ 300.410436] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.173Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"6cace9af7ddd6f9dff0f5244","created_at":"2026-09-03T10:18:01.610Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ec05871b4f16b5433673727ac8d67e7d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-03T10:18:01.622Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-6cace9af7ddd6f9dff0f5244: start","job_status":"start","queue_duration_s":1.551158,"scheduling_latency_s":1.551211}1419gitlab # [ 300.425001] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.192Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1420gitlab # [ 300.428104] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.204Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"6cace9af7ddd6f9dff0f5244","created_at":"2026-09-03T10:18:01.610Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ec05871b4f16b5433673727ac8d67e7d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-03T10:18:01.622Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-6cace9af7ddd6f9dff0f5244: done: 0.031002 sec","job_status":"done","queue_duration_s":1.551158,"scheduling_latency_s":1.551211,"redis_calls":7,"redis_duration_s":0.0023699999999999997,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00171,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00066,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019859,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031002,"completed_at":"2026-09-03T10:18:03.204Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1421gitlab # [ 300.468293] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.206Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"a3a204ecf06535ac81cb6833","created_at":"2026-09-03T10:18:01.642Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1e1cf13a1de0d483a115a626b8c79757","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-03T10:18:01.651Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-a3a204ecf06535ac81cb6833: start","job_status":"start","queue_duration_s":1.555054,"scheduling_latency_s":1.555088}1422gitlab # [ 300.481604] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.247Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"a3a204ecf06535ac81cb6833","created_at":"2026-09-03T10:18:01.642Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1e1cf13a1de0d483a115a626b8c79757","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-03T10:18:01.651Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-a3a204ecf06535ac81cb6833: done: 0.040669 sec","job_status":"done","queue_duration_s":1.555054,"scheduling_latency_s":1.555088,"redis_calls":14,"redis_duration_s":0.003125,"redis_read_bytes":16,"redis_write_bytes":4030,"redis_queues_calls":2,"redis_queues_duration_s":0.000392,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002086,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000647,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030262,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.040669,"completed_at":"2026-09-03T10:18:03.247Z","load_balancing_strategy":"primary","db_duration_s":0.002022,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1423gitlab # [ 300.522015] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.249Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"c60ba1ff86d7e5f98ef32043","created_at":"2026-09-03T10:18:01.670Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"43e01dd0aa679d5606fe2dc6adbe550f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-03T10:18:01.680Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-c60ba1ff86d7e5f98ef32043: start","job_status":"start","queue_duration_s":1.568913,"scheduling_latency_s":1.568944}1424gitlab # [ 300.536365] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.260Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1425gitlab # [ 300.539855] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.268Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"c60ba1ff86d7e5f98ef32043","created_at":"2026-09-03T10:18:01.670Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"43e01dd0aa679d5606fe2dc6adbe550f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-03T10:18:01.680Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-c60ba1ff86d7e5f98ef32043: done: 0.019029 sec","job_status":"done","queue_duration_s":1.568913,"scheduling_latency_s":1.568944,"redis_calls":7,"redis_duration_s":0.001475,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001068,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000407,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012087,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019029,"completed_at":"2026-09-03T10:18:03.268Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1426gitlab # [ 300.581260] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.269Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"3940e9305d1745b551b40b87","created_at":"2026-09-03T10:18:01.698Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"869dd946a16281acf602e9e055a68f1f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-03T10:18:01.707Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-3940e9305d1745b551b40b87: start","job_status":"start","queue_duration_s":1.562251,"scheduling_latency_s":1.562281}1427gitlab # [ 300.594310] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.279Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1428gitlab # [ 300.598049] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.285Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"3940e9305d1745b551b40b87","created_at":"2026-09-03T10:18:01.698Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"869dd946a16281acf602e9e055a68f1f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-03T10:18:01.707Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-3940e9305d1745b551b40b87: done: 0.015928 sec","job_status":"done","queue_duration_s":1.562251,"scheduling_latency_s":1.562281,"redis_calls":7,"redis_duration_s":0.001206,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00088,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000326,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010035,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015928,"completed_at":"2026-09-03T10:18:03.285Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1429gitlab # [ 300.636455] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.287Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"f39d9e162462ae3b034a7b30","created_at":"2026-09-03T10:18:01.725Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e8b95662690b6b87ed922e3a6a8a8a96","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-03T10:18:01.734Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-f39d9e162462ae3b034a7b30: start","job_status":"start","queue_duration_s":1.552688,"scheduling_latency_s":1.552707}1430gitlab # [ 300.649215] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.311Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"f39d9e162462ae3b034a7b30","created_at":"2026-09-03T10:18:01.725Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e8b95662690b6b87ed922e3a6a8a8a96","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-03T10:18:01.734Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-f39d9e162462ae3b034a7b30: done: 0.02468 sec","job_status":"done","queue_duration_s":1.552688,"scheduling_latency_s":1.552707,"redis_calls":8,"redis_duration_s":0.00124,"redis_read_bytes":133,"redis_write_bytes":811,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000144,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":70,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000806,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00029,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017054,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02468,"completed_at":"2026-09-03T10:18:03.311Z","load_balancing_strategy":"primary","db_duration_s":0.002927,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1431gitlab # [ 300.688964] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.313Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"fd0ebf465915a62168146767","created_at":"2026-09-03T10:18:01.796Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"65ce7f7494d4f620e125d2b7dceb42f5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-03T10:18:01.805Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-fd0ebf465915a62168146767: start","job_status":"start","queue_duration_s":1.508014,"scheduling_latency_s":1.508033}1432gitlab # [ 300.723827] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.594Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"fd0ebf465915a62168146767","created_at":"2026-09-03T10:18:01.796Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"65ce7f7494d4f620e125d2b7dceb42f5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-03T10:18:01.805Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-fd0ebf465915a62168146767: done: 0.2812 sec","job_status":"done","queue_duration_s":1.508014,"scheduling_latency_s":1.508033,"redis_calls":11,"redis_duration_s":0.002056,"redis_read_bytes":9,"redis_write_bytes":1262,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000537,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":275,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000766,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000753,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.056,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":130,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.056,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.202337,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00051736,"exclusive_lock_hold_duration_s":0.26217242,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.2812,"completed_at":"2026-09-03T10:18:03.594Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.089109,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1433gitlab # [ 300.769103] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.595Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"e0560e4c4f62262aa23ce4c2","created_at":"2026-09-03T10:18:01.833Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c4978ef92f9605c6c9ad2313ac9ce914","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-03T10:18:01.843Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-e0560e4c4f62262aa23ce4c2: start","job_status":"start","queue_duration_s":1.751744,"scheduling_latency_s":1.751766}1434gitlab # [ 300.782811] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.629Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"e0560e4c4f62262aa23ce4c2","created_at":"2026-09-03T10:18:01.833Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c4978ef92f9605c6c9ad2313ac9ce914","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-03T10:18:01.843Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-e0560e4c4f62262aa23ce4c2: done: 0.034032 sec","job_status":"done","queue_duration_s":1.751744,"scheduling_latency_s":1.751766,"redis_calls":7,"redis_duration_s":0.001331,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000806,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000525,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010372,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.034032,"completed_at":"2026-09-03T10:18:03.629Z","load_balancing_strategy":"primary","db_duration_s":0.018389,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1435gitlab # [ 300.823126] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.631Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"cb76eb35ea9dba7da3a38df9","created_at":"2026-09-03T10:18:01.941Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dbcd154a10fdff3f1dd1dcbe840be968","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-03T10:18:01.948Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-cb76eb35ea9dba7da3a38df9: start","job_status":"start","queue_duration_s":1.682053,"scheduling_latency_s":1.682073}1436gitlab # [ 300.837490] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.638Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1437gitlab # [ 300.840792] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.644Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"cb76eb35ea9dba7da3a38df9","created_at":"2026-09-03T10:18:01.941Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dbcd154a10fdff3f1dd1dcbe840be968","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-03T10:18:01.948Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-cb76eb35ea9dba7da3a38df9: done: 0.013237 sec","job_status":"done","queue_duration_s":1.682053,"scheduling_latency_s":1.682073,"redis_calls":7,"redis_duration_s":0.001022,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000731,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000291,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008394,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013237,"completed_at":"2026-09-03T10:18:03.644Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1438gitlab # [ 300.880321] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.645Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"5124d0cb6e88a2abf511f99d","created_at":"2026-09-03T10:18:01.968Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c8965f36b9c546be3a58a8381d692b93","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-03T10:18:01.977Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-5124d0cb6e88a2abf511f99d: start","job_status":"start","queue_duration_s":1.667914,"scheduling_latency_s":1.667932}1439gitlab # [ 300.894453] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.658Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"5124d0cb6e88a2abf511f99d","created_at":"2026-09-03T10:18:01.968Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c8965f36b9c546be3a58a8381d692b93","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-03T10:18:01.977Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-5124d0cb6e88a2abf511f99d: done: 0.013287 sec","job_status":"done","queue_duration_s":1.667914,"scheduling_latency_s":1.667932,"redis_calls":7,"redis_duration_s":0.001052,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000731,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000321,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008728,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013287,"completed_at":"2026-09-03T10:18:03.658Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1440gitlab # [ 300.933738] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.659Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"fbdd1adb327087b4f38aa35d","created_at":"2026-09-03T10:18:02.020Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ace9fac03732978938c809d7401d8d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-03T10:18:02.029Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-fbdd1adb327087b4f38aa35d: start","job_status":"start","queue_duration_s":1.630888,"scheduling_latency_s":1.630906}1441gitlab # [ 300.948069] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.672Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"fbdd1adb327087b4f38aa35d","created_at":"2026-09-03T10:18:02.020Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ace9fac03732978938c809d7401d8d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-03T10:18:02.029Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-fbdd1adb327087b4f38aa35d: done: 0.01283 sec","job_status":"done","queue_duration_s":1.630888,"scheduling_latency_s":1.630906,"redis_calls":7,"redis_duration_s":0.000991,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000734,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000257,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008466,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01283,"completed_at":"2026-09-03T10:18:03.672Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1442gitlab # [ 300.989744] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.673Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"24a2c16b6d57b5ef8306a306","created_at":"2026-09-03T10:18:02.047Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3df79a9968327ec95f73b3c9c0ac95b0","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-03T10:18:02.057Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-24a2c16b6d57b5ef8306a306: start","job_status":"start","queue_duration_s":1.616722,"scheduling_latency_s":1.61674}1443gitlab # [ 301.004041] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.690Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"24a2c16b6d57b5ef8306a306","created_at":"2026-09-03T10:18:02.047Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3df79a9968327ec95f73b3c9c0ac95b0","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-03T10:18:02.057Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-24a2c16b6d57b5ef8306a306: done: 0.016539 sec","job_status":"done","queue_duration_s":1.616722,"scheduling_latency_s":1.61674,"redis_calls":9,"redis_duration_s":0.0012720000000000001,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000669,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000603,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010262,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00047478,"exclusive_lock_hold_duration_s":0.00360332,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.016539,"completed_at":"2026-09-03T10:18:03.690Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001911,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1444gitlab # [ 301.044663] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.691Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"531b710e35cf670a8dc08d7a","created_at":"2026-09-03T10:18:02.104Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"da7fc195791a4cb8b20604df1d643917","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-03T10:18:02.127Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-531b710e35cf670a8dc08d7a: start","job_status":"start","queue_duration_s":1.563937,"scheduling_latency_s":1.563955}1445gitlab # [ 301.058809] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.721Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"531b710e35cf670a8dc08d7a","created_at":"2026-09-03T10:18:02.104Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"da7fc195791a4cb8b20604df1d643917","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-03T10:18:02.127Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-531b710e35cf670a8dc08d7a: done: 0.029555 sec","job_status":"done","queue_duration_s":1.563937,"scheduling_latency_s":1.563955,"redis_calls":10,"redis_duration_s":0.001401,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000313,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000801,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000287,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016997,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026024,"duration_s":0.029555,"completed_at":"2026-09-03T10:18:03.721Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006423,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1446gitlab # [ 301.100277] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.722Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"ffe97b3c7e2b7898d5602c4f","created_at":"2026-09-03T10:18:02.149Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5054bb69b4a192b73f90ba180587a0c0","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-03T10:18:02.158Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-ffe97b3c7e2b7898d5602c4f: start","job_status":"start","queue_duration_s":1.563681,"scheduling_latency_s":1.563699}1447gitlab # [ 301.114527] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.737Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"ffe97b3c7e2b7898d5602c4f","created_at":"2026-09-03T10:18:02.149Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-a8be1cf8155444d2","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5054bb69b4a192b73f90ba180587a0c0","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-03T10:18:02.158Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-ffe97b3c7e2b7898d5602c4f: done: 0.01489 sec","job_status":"done","queue_duration_s":1.563681,"scheduling_latency_s":1.563699,"redis_calls":7,"redis_duration_s":0.000987,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000706,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000281,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00909,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01489,"completed_at":"2026-09-03T10:18:03.737Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001511,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1448gitlab # [ 301.156381] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.738Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ed356ab90d3c3dcecc6faf5","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ed356ab90d3c3dcecc6faf5: start","job_status":"start","queue_duration_s":0.647521,"scheduling_latency_s":0.64754}1449gitlab # [ 301.168980] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.752Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ed356ab90d3c3dcecc6faf5","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ed356ab90d3c3dcecc6faf5: done: 0.014301 sec","job_status":"done","queue_duration_s":0.647521,"scheduling_latency_s":0.64754,"redis_calls":13,"redis_duration_s":0.001516,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000984,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009788,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014301,"completed_at":"2026-09-03T10:18:03.752Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1450gitlab # [ 301.207619] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.753Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3da5eaa94df7230f26ad4ff7","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3da5eaa94df7230f26ad4ff7: start","job_status":"start","queue_duration_s":0.662901,"scheduling_latency_s":0.662917}1451gitlab # [ 301.220143] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.767Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3da5eaa94df7230f26ad4ff7","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3da5eaa94df7230f26ad4ff7: done: 0.014163 sec","job_status":"done","queue_duration_s":0.662901,"scheduling_latency_s":0.662917,"redis_calls":13,"redis_duration_s":0.001435,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000923,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009665,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014163,"completed_at":"2026-09-03T10:18:03.767Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1452gitlab # [ 301.258340] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.769Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2060cc521690610db4129561","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2060cc521690610db4129561: start","job_status":"start","queue_duration_s":0.678214,"scheduling_latency_s":0.67823}1453gitlab # [ 301.270651] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.783Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2060cc521690610db4129561","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2060cc521690610db4129561: done: 0.014271 sec","job_status":"done","queue_duration_s":0.678214,"scheduling_latency_s":0.67823,"redis_calls":13,"redis_duration_s":0.0014320000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000922,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00982,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014271,"completed_at":"2026-09-03T10:18:03.783Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1454gitlab # [ 301.308872] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.784Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"871447bd0be464bca16e7fab","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-871447bd0be464bca16e7fab: start","job_status":"start","queue_duration_s":0.693624,"scheduling_latency_s":0.693641}1455gitlab # [ 301.320827] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.798Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"871447bd0be464bca16e7fab","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-871447bd0be464bca16e7fab: done: 0.014331 sec","job_status":"done","queue_duration_s":0.693624,"scheduling_latency_s":0.693641,"redis_calls":13,"redis_duration_s":0.001451,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000927,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00987,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014331,"completed_at":"2026-09-03T10:18:03.798Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1456gitlab # [ 301.360371] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.799Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70de899a89dc5fe1ef11c067","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70de899a89dc5fe1ef11c067: start","job_status":"start","queue_duration_s":0.709088,"scheduling_latency_s":0.709105}1457gitlab # [ 301.372290] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.813Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70de899a89dc5fe1ef11c067","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70de899a89dc5fe1ef11c067: done: 0.014076 sec","job_status":"done","queue_duration_s":0.709088,"scheduling_latency_s":0.709105,"redis_calls":13,"redis_duration_s":0.001467,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000958,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009765,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014076,"completed_at":"2026-09-03T10:18:03.813Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1458gitlab # [ 301.409913] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.815Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa6608188320c544793dc3b0","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa6608188320c544793dc3b0: start","job_status":"start","queue_duration_s":0.724268,"scheduling_latency_s":0.724286}1459gitlab # [ 301.422267] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.829Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa6608188320c544793dc3b0","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa6608188320c544793dc3b0: done: 0.01451 sec","job_status":"done","queue_duration_s":0.724268,"scheduling_latency_s":0.724286,"redis_calls":13,"redis_duration_s":0.00175,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000817,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000933,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009774,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01451,"completed_at":"2026-09-03T10:18:03.829Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1460gitlab # [ 301.460695] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.830Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c18c8122b6d1dee6c9a9c5ba","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c18c8122b6d1dee6c9a9c5ba: start","job_status":"start","queue_duration_s":0.739872,"scheduling_latency_s":0.739889}1461gitlab # [ 301.472973] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.844Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c18c8122b6d1dee6c9a9c5ba","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c18c8122b6d1dee6c9a9c5ba: done: 0.01425 sec","job_status":"done","queue_duration_s":0.739872,"scheduling_latency_s":0.739889,"redis_calls":13,"redis_duration_s":0.001519,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000982,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009828,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01425,"completed_at":"2026-09-03T10:18:03.844Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1462gitlab # [ 301.511457] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.846Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b7e967f0c26e57d58c9c9c5","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b7e967f0c26e57d58c9c9c5: start","job_status":"start","queue_duration_s":0.755242,"scheduling_latency_s":0.755258}1463gitlab # [ 301.523935] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.860Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b7e967f0c26e57d58c9c9c5","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b7e967f0c26e57d58c9c9c5: done: 0.014308 sec","job_status":"done","queue_duration_s":0.755242,"scheduling_latency_s":0.755258,"redis_calls":13,"redis_duration_s":0.001459,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000933,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00984,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014308,"completed_at":"2026-09-03T10:18:03.860Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1464gitlab # [ 301.563873] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.861Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ee996393a7524c76b46f647","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ee996393a7524c76b46f647: start","job_status":"start","queue_duration_s":0.770824,"scheduling_latency_s":0.770842}1465gitlab # [ 301.576304] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.890Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ee996393a7524c76b46f647","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ee996393a7524c76b46f647: done: 0.029059 sec","job_status":"done","queue_duration_s":0.770824,"scheduling_latency_s":0.770842,"redis_calls":13,"redis_duration_s":0.0014199999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0009,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024512,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029059,"completed_at":"2026-09-03T10:18:03.890Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1466gitlab # [ 301.614912] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.891Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6fb092c733ec4b4c2adf3abd","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6fb092c733ec4b4c2adf3abd: start","job_status":"start","queue_duration_s":0.801065,"scheduling_latency_s":0.801083}1467gitlab # [ 301.627329] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.906Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6fb092c733ec4b4c2adf3abd","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6fb092c733ec4b4c2adf3abd: done: 0.014357 sec","job_status":"done","queue_duration_s":0.801065,"scheduling_latency_s":0.801083,"redis_calls":13,"redis_duration_s":0.0014550000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000928,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009942,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014357,"completed_at":"2026-09-03T10:18:03.906Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1468gitlab # [ 301.666124] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.907Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8da18806cc7e3cbc3c388c27","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8da18806cc7e3cbc3c388c27: start","job_status":"start","queue_duration_s":0.816632,"scheduling_latency_s":0.816649}1469gitlab # [ 301.678344] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.921Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8da18806cc7e3cbc3c388c27","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8da18806cc7e3cbc3c388c27: done: 0.014154 sec","job_status":"done","queue_duration_s":0.816632,"scheduling_latency_s":0.816649,"redis_calls":13,"redis_duration_s":0.001457,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000943,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009815,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014154,"completed_at":"2026-09-03T10:18:03.921Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1470gitlab # [ 301.716642] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.922Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f90c05e080c6dfdd28548084","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f90c05e080c6dfdd28548084: start","job_status":"start","queue_duration_s":0.831876,"scheduling_latency_s":0.831894}1471gitlab # [ 301.728628] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.937Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f90c05e080c6dfdd28548084","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f90c05e080c6dfdd28548084: done: 0.014501 sec","job_status":"done","queue_duration_s":0.831876,"scheduling_latency_s":0.831894,"redis_calls":13,"redis_duration_s":0.00172,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000761,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000959,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009906,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014501,"completed_at":"2026-09-03T10:18:03.937Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1472gitlab # [ 301.767456] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.938Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa6c5c0a6f42170afc0cb763","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa6c5c0a6f42170afc0cb763: start","job_status":"start","queue_duration_s":0.847436,"scheduling_latency_s":0.847454}1473gitlab # [ 301.780117] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.952Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa6c5c0a6f42170afc0cb763","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa6c5c0a6f42170afc0cb763: done: 0.013893 sec","job_status":"done","queue_duration_s":0.847436,"scheduling_latency_s":0.847454,"redis_calls":13,"redis_duration_s":0.001431,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009508,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013893,"completed_at":"2026-09-03T10:18:03.952Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1474gitlab # [ 301.818627] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.953Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f3d4bb6253c44e862127770d","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f3d4bb6253c44e862127770d: start","job_status":"start","queue_duration_s":0.862401,"scheduling_latency_s":0.862417}1475gitlab # [ 301.831051] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.967Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f3d4bb6253c44e862127770d","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f3d4bb6253c44e862127770d: done: 0.014112 sec","job_status":"done","queue_duration_s":0.862401,"scheduling_latency_s":0.862417,"redis_calls":13,"redis_duration_s":0.001459,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000919,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009741,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014112,"completed_at":"2026-09-03T10:18:03.967Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1476gitlab # [ 301.869872] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.968Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"48dbcba44d08646fe2216115","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-48dbcba44d08646fe2216115: start","job_status":"start","queue_duration_s":0.877644,"scheduling_latency_s":0.877661}1477gitlab # [ 301.882230] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.982Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"48dbcba44d08646fe2216115","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-48dbcba44d08646fe2216115: done: 0.013652 sec","job_status":"done","queue_duration_s":0.877644,"scheduling_latency_s":0.877661,"redis_calls":13,"redis_duration_s":0.0014199999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000913,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009371,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013652,"completed_at":"2026-09-03T10:18:03.982Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1478gitlab # [ 301.920911] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.983Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"88b6e8dd26759ece4409af1d","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-88b6e8dd26759ece4409af1d: start","job_status":"start","queue_duration_s":0.892407,"scheduling_latency_s":0.892425}1479gitlab # [ 301.933539] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.996Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"88b6e8dd26759ece4409af1d","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-88b6e8dd26759ece4409af1d: done: 0.013478 sec","job_status":"done","queue_duration_s":0.892407,"scheduling_latency_s":0.892425,"redis_calls":13,"redis_duration_s":0.001416,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000502,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000914,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009327,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013478,"completed_at":"2026-09-03T10:18:03.996Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1480gitlab # [ 301.973321] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:03.997Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b86aa78ed058a7de207eefbc","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b86aa78ed058a7de207eefbc: start","job_status":"start","queue_duration_s":0.906951,"scheduling_latency_s":0.906968}1481gitlab # [ 301.985701] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.012Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b86aa78ed058a7de207eefbc","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b86aa78ed058a7de207eefbc: done: 0.01498 sec","job_status":"done","queue_duration_s":0.906951,"scheduling_latency_s":0.906968,"redis_calls":13,"redis_duration_s":0.00258,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002045,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009558,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01498,"completed_at":"2026-09-03T10:18:04.012Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1482gitlab # [ 302.024760] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.013Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"884b96a085b1dec10946ab1b","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-884b96a085b1dec10946ab1b: start","job_status":"start","queue_duration_s":0.923035,"scheduling_latency_s":0.923052}1483gitlab # [ 302.037016] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.028Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"884b96a085b1dec10946ab1b","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-884b96a085b1dec10946ab1b: done: 0.014415 sec","job_status":"done","queue_duration_s":0.923035,"scheduling_latency_s":0.923052,"redis_calls":13,"redis_duration_s":0.001515,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000536,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000979,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009516,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014415,"completed_at":"2026-09-03T10:18:04.028Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1484gitlab # [ 302.075898] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.029Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"40940591e8dff9ece3cb1840","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-40940591e8dff9ece3cb1840: start","job_status":"start","queue_duration_s":0.938608,"scheduling_latency_s":0.938627}1485gitlab # [ 302.088249] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.043Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"40940591e8dff9ece3cb1840","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-40940591e8dff9ece3cb1840: done: 0.013677 sec","job_status":"done","queue_duration_s":0.938608,"scheduling_latency_s":0.938627,"redis_calls":13,"redis_duration_s":0.001437,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000536,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000901,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009357,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013677,"completed_at":"2026-09-03T10:18:04.043Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1486gitlab # [ 302.127419] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.044Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b717e2ad6bf9d23928580fb4","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b717e2ad6bf9d23928580fb4: start","job_status":"start","queue_duration_s":0.953357,"scheduling_latency_s":0.953374}1487gitlab # [ 302.140088] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.057Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b717e2ad6bf9d23928580fb4","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b717e2ad6bf9d23928580fb4: done: 0.013522 sec","job_status":"done","queue_duration_s":0.953357,"scheduling_latency_s":0.953374,"redis_calls":13,"redis_duration_s":0.001395,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00089,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009337,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013522,"completed_at":"2026-09-03T10:18:04.057Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1488gitlab # [ 302.180362] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.058Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f0cdf3c25a9e898915163bee","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f0cdf3c25a9e898915163bee: start","job_status":"start","queue_duration_s":0.96795,"scheduling_latency_s":0.967966}1489gitlab # [ 302.192982] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.072Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f0cdf3c25a9e898915163bee","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f0cdf3c25a9e898915163bee: done: 0.013569 sec","job_status":"done","queue_duration_s":0.96795,"scheduling_latency_s":0.967966,"redis_calls":13,"redis_duration_s":0.001414,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000908,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009341,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013569,"completed_at":"2026-09-03T10:18:04.072Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1490gitlab # [ 302.232133] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.073Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7102c25d4dc6badd6c8ed3a1","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7102c25d4dc6badd6c8ed3a1: start","job_status":"start","queue_duration_s":0.982586,"scheduling_latency_s":0.982603}1491gitlab # [ 302.244475] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.087Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7102c25d4dc6badd6c8ed3a1","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7102c25d4dc6badd6c8ed3a1: done: 0.01376 sec","job_status":"done","queue_duration_s":0.982586,"scheduling_latency_s":0.982603,"redis_calls":13,"redis_duration_s":0.001434,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000908,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009437,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01376,"completed_at":"2026-09-03T10:18:04.087Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1492gitlab # [ 302.283993] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.088Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36b5e76e72ff56aa5097b942","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36b5e76e72ff56aa5097b942: start","job_status":"start","queue_duration_s":0.997426,"scheduling_latency_s":0.997443}1493gitlab # [ 302.296089] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.101Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36b5e76e72ff56aa5097b942","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36b5e76e72ff56aa5097b942: done: 0.01365 sec","job_status":"done","queue_duration_s":0.997426,"scheduling_latency_s":0.997443,"redis_calls":13,"redis_duration_s":0.001449,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000501,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000948,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009404,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01365,"completed_at":"2026-09-03T10:18:04.101Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1494gitlab # [ 302.333959] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.102Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b3543b2f300a0bb7bcc3449","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b3543b2f300a0bb7bcc3449: start","job_status":"start","queue_duration_s":1.012139,"scheduling_latency_s":1.012156}1495gitlab # [ 302.346151] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.116Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b3543b2f300a0bb7bcc3449","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b3543b2f300a0bb7bcc3449: done: 0.013617 sec","job_status":"done","queue_duration_s":1.012139,"scheduling_latency_s":1.012156,"redis_calls":13,"redis_duration_s":0.001425,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000921,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009396,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013617,"completed_at":"2026-09-03T10:18:04.116Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1496gitlab # [ 302.385687] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.117Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05597c0eb68eb1b19b556763","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05597c0eb68eb1b19b556763: start","job_status":"start","queue_duration_s":1.026832,"scheduling_latency_s":1.026848}1497gitlab # [ 302.397734] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.131Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05597c0eb68eb1b19b556763","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05597c0eb68eb1b19b556763: done: 0.013833 sec","job_status":"done","queue_duration_s":1.026832,"scheduling_latency_s":1.026848,"redis_calls":13,"redis_duration_s":0.001591,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001063,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013833,"completed_at":"2026-09-03T10:18:04.131Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1498gitlab # [ 302.435681] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.132Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac63dd684cbf2ac3aee2f1fc","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac63dd684cbf2ac3aee2f1fc: start","job_status":"start","queue_duration_s":1.041747,"scheduling_latency_s":1.041763}1499gitlab # [ 302.448070] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.146Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac63dd684cbf2ac3aee2f1fc","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac63dd684cbf2ac3aee2f1fc: done: 0.013598 sec","job_status":"done","queue_duration_s":1.041747,"scheduling_latency_s":1.041763,"redis_calls":13,"redis_duration_s":0.0014060000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000902,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009373,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013598,"completed_at":"2026-09-03T10:18:04.146Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1500gitlab # [ 302.485842] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.147Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0093b693044e458267f21cd4","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0093b693044e458267f21cd4: start","job_status":"start","queue_duration_s":1.056463,"scheduling_latency_s":1.05648}1501gitlab # [ 302.497978] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.161Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0093b693044e458267f21cd4","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0093b693044e458267f21cd4: done: 0.013795 sec","job_status":"done","queue_duration_s":1.056463,"scheduling_latency_s":1.05648,"redis_calls":13,"redis_duration_s":0.00146,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000946,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00952,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013795,"completed_at":"2026-09-03T10:18:04.160Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1502gitlab # [ 302.536763] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.162Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ed728b00123f1b027294aca","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ed728b00123f1b027294aca: start","job_status":"start","queue_duration_s":1.07137,"scheduling_latency_s":1.071386}1503gitlab # [ 302.549123] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.175Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ed728b00123f1b027294aca","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ed728b00123f1b027294aca: done: 0.013706 sec","job_status":"done","queue_duration_s":1.07137,"scheduling_latency_s":1.071386,"redis_calls":13,"redis_duration_s":0.00139,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000882,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00932,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013706,"completed_at":"2026-09-03T10:18:04.175Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1504gitlab # [ 302.589934] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.176Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e18d8c83373c03f3c98202e","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e18d8c83373c03f3c98202e: start","job_status":"start","queue_duration_s":1.086167,"scheduling_latency_s":1.086184}1505gitlab # [ 302.602407] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.190Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e18d8c83373c03f3c98202e","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e18d8c83373c03f3c98202e: done: 0.013617 sec","job_status":"done","queue_duration_s":1.086167,"scheduling_latency_s":1.086184,"redis_calls":13,"redis_duration_s":0.001428,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000902,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009361,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013617,"completed_at":"2026-09-03T10:18:04.190Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1506gitlab # [ 302.641975] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.191Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c12a18732ea71a63f377b5d2","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c12a18732ea71a63f377b5d2: start","job_status":"start","queue_duration_s":1.1009,"scheduling_latency_s":1.100917}1507gitlab # [ 302.654347] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.205Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c12a18732ea71a63f377b5d2","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c12a18732ea71a63f377b5d2: done: 0.01352 sec","job_status":"done","queue_duration_s":1.1009,"scheduling_latency_s":1.100917,"redis_calls":13,"redis_duration_s":0.001436,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000901,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009321,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01352,"completed_at":"2026-09-03T10:18:04.205Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1508gitlab # [ 302.693459] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.206Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a5b47d1787b21345054af197","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a5b47d1787b21345054af197: start","job_status":"start","queue_duration_s":1.115491,"scheduling_latency_s":1.115507}1509gitlab # [ 302.706055] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.219Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a5b47d1787b21345054af197","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a5b47d1787b21345054af197: done: 0.013701 sec","job_status":"done","queue_duration_s":1.115491,"scheduling_latency_s":1.115507,"redis_calls":13,"redis_duration_s":0.001421,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000519,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000902,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009367,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013701,"completed_at":"2026-09-03T10:18:04.219Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1510gitlab # [ 302.744958] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.221Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fdd114a6e7ba4cf168ed08e4","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fdd114a6e7ba4cf168ed08e4: start","job_status":"start","queue_duration_s":1.130295,"scheduling_latency_s":1.130313}1511gitlab # [ 302.757068] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.235Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fdd114a6e7ba4cf168ed08e4","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fdd114a6e7ba4cf168ed08e4: done: 0.014069 sec","job_status":"done","queue_duration_s":1.130295,"scheduling_latency_s":1.130313,"redis_calls":13,"redis_duration_s":0.001624,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00111,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009488,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014069,"completed_at":"2026-09-03T10:18:04.235Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1512gitlab # [ 302.797035] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.236Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b23c41bab3b1df1fe7acea95","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b23c41bab3b1df1fe7acea95: start","job_status":"start","queue_duration_s":1.145423,"scheduling_latency_s":1.145439}1513gitlab # [ 302.809433] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.249Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b23c41bab3b1df1fe7acea95","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b23c41bab3b1df1fe7acea95: done: 0.013529 sec","job_status":"done","queue_duration_s":1.145423,"scheduling_latency_s":1.145439,"redis_calls":13,"redis_duration_s":0.001423,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000918,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009392,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013529,"completed_at":"2026-09-03T10:18:04.249Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1514gitlab # [ 302.848176] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.250Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b4f05470892aa65376329e5","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b4f05470892aa65376329e5: start","job_status":"start","queue_duration_s":1.159996,"scheduling_latency_s":1.160012}1515gitlab # [ 302.860512] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.264Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b4f05470892aa65376329e5","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b4f05470892aa65376329e5: done: 0.013476 sec","job_status":"done","queue_duration_s":1.159996,"scheduling_latency_s":1.160012,"redis_calls":13,"redis_duration_s":0.001415,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000909,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009279,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013476,"completed_at":"2026-09-03T10:18:04.264Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1516gitlab # [ 302.898383] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.265Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de405bfb1e1487d102354e20","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de405bfb1e1487d102354e20: start","job_status":"start","queue_duration_s":1.174546,"scheduling_latency_s":1.174562}1517gitlab # [ 302.910554] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.279Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de405bfb1e1487d102354e20","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de405bfb1e1487d102354e20: done: 0.013653 sec","job_status":"done","queue_duration_s":1.174546,"scheduling_latency_s":1.174562,"redis_calls":13,"redis_duration_s":0.001425,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00091,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009363,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013653,"completed_at":"2026-09-03T10:18:04.278Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1518gitlab # [ 302.948439] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.280Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d3e6a551ef212f4da432b41","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d3e6a551ef212f4da432b41: start","job_status":"start","queue_duration_s":1.189371,"scheduling_latency_s":1.189389}1519gitlab # [ 302.960461] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.293Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d3e6a551ef212f4da432b41","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d3e6a551ef212f4da432b41: done: 0.013678 sec","job_status":"done","queue_duration_s":1.189371,"scheduling_latency_s":1.189389,"redis_calls":13,"redis_duration_s":0.001462,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000955,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009441,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013678,"completed_at":"2026-09-03T10:18:04.293Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1520gitlab # [ 303.000771] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.294Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e521c305a524527a7a2f1963","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e521c305a524527a7a2f1963: start","job_status":"start","queue_duration_s":1.204152,"scheduling_latency_s":1.204169}1521gitlab # [ 303.012861] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.308Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e521c305a524527a7a2f1963","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e521c305a524527a7a2f1963: done: 0.013565 sec","job_status":"done","queue_duration_s":1.204152,"scheduling_latency_s":1.204169,"redis_calls":13,"redis_duration_s":0.001454,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000946,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009336,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013565,"completed_at":"2026-09-03T10:18:04.308Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1522gitlab # [ 303.051706] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.309Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e434cafc98435ec64fe4b36d","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e434cafc98435ec64fe4b36d: start","job_status":"start","queue_duration_s":1.21878,"scheduling_latency_s":1.218796}1523gitlab # [ 303.064246] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.323Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e434cafc98435ec64fe4b36d","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e434cafc98435ec64fe4b36d: done: 0.013579 sec","job_status":"done","queue_duration_s":1.21878,"scheduling_latency_s":1.218796,"redis_calls":13,"redis_duration_s":0.001411,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000896,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009333,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013579,"completed_at":"2026-09-03T10:18:04.323Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1524gitlab # [ 303.102923] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.324Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b9670d74e4c21bbd4dc6a21","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b9670d74e4c21bbd4dc6a21: start","job_status":"start","queue_duration_s":1.233438,"scheduling_latency_s":1.233454}1525gitlab # [ 303.115337] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.338Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b9670d74e4c21bbd4dc6a21","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b9670d74e4c21bbd4dc6a21: done: 0.014054 sec","job_status":"done","queue_duration_s":1.233438,"scheduling_latency_s":1.233454,"redis_calls":13,"redis_duration_s":0.0016380000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000718,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00092,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009635,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014054,"completed_at":"2026-09-03T10:18:04.338Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1526gitlab # [ 303.154256] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.339Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b216cb4514e32b23b1d65cf","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b216cb4514e32b23b1d65cf: start","job_status":"start","queue_duration_s":1.248668,"scheduling_latency_s":1.248685}1527gitlab # [ 303.166618] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.353Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b216cb4514e32b23b1d65cf","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b216cb4514e32b23b1d65cf: done: 0.013681 sec","job_status":"done","queue_duration_s":1.248668,"scheduling_latency_s":1.248685,"redis_calls":13,"redis_duration_s":0.001448,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000918,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009384,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013681,"completed_at":"2026-09-03T10:18:04.353Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1528gitlab # [ 303.205961] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.354Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"281fb7764a356f469500fe50","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-281fb7764a356f469500fe50: start","job_status":"start","queue_duration_s":1.263433,"scheduling_latency_s":1.263449}1529gitlab # [ 303.218131] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.367Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"281fb7764a356f469500fe50","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-281fb7764a356f469500fe50: done: 0.013568 sec","job_status":"done","queue_duration_s":1.263433,"scheduling_latency_s":1.263449,"redis_calls":13,"redis_duration_s":0.001404,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000898,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009305,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013568,"completed_at":"2026-09-03T10:18:04.367Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1530gitlab # [ 303.256525] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.368Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"54f08e7b0e45a6b868fafa7b","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-54f08e7b0e45a6b868fafa7b: start","job_status":"start","queue_duration_s":1.278097,"scheduling_latency_s":1.278115}1531gitlab # [ 303.268520] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.382Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"54f08e7b0e45a6b868fafa7b","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-54f08e7b0e45a6b868fafa7b: done: 0.01346 sec","job_status":"done","queue_duration_s":1.278097,"scheduling_latency_s":1.278115,"redis_calls":13,"redis_duration_s":0.001434,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000905,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009251,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01346,"completed_at":"2026-09-03T10:18:04.382Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1532gitlab # [ 303.306775] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.383Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a5ea6cd51be5bf33c044cc1d","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a5ea6cd51be5bf33c044cc1d: start","job_status":"start","queue_duration_s":1.292671,"scheduling_latency_s":1.292688}1533gitlab # [ 303.318922] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.396Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a5ea6cd51be5bf33c044cc1d","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a5ea6cd51be5bf33c044cc1d: done: 0.013523 sec","job_status":"done","queue_duration_s":1.292671,"scheduling_latency_s":1.292688,"redis_calls":13,"redis_duration_s":0.0014299999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000502,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000928,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009324,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013523,"completed_at":"2026-09-03T10:18:04.396Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1534gitlab # [ 303.356732] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.398Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8712ac24ea98b231d7797873","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8712ac24ea98b231d7797873: start","job_status":"start","queue_duration_s":1.307335,"scheduling_latency_s":1.307353}1535gitlab # [ 303.368659] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.411Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8712ac24ea98b231d7797873","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8712ac24ea98b231d7797873: done: 0.013655 sec","job_status":"done","queue_duration_s":1.307335,"scheduling_latency_s":1.307353,"redis_calls":13,"redis_duration_s":0.001399,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000893,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009322,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013655,"completed_at":"2026-09-03T10:18:04.411Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1536gitlab # [ 303.407742] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.412Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e77e5ffa402a8f7e37d3f12e","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e77e5ffa402a8f7e37d3f12e: start","job_status":"start","queue_duration_s":1.322055,"scheduling_latency_s":1.322073}1537gitlab # [ 303.419780] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.426Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e77e5ffa402a8f7e37d3f12e","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e77e5ffa402a8f7e37d3f12e: done: 0.013888 sec","job_status":"done","queue_duration_s":1.322055,"scheduling_latency_s":1.322073,"redis_calls":13,"redis_duration_s":0.001438,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000927,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009629,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013888,"completed_at":"2026-09-03T10:18:04.426Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1538gitlab # [ 303.458370] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.427Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"768f6a53aba918c8a59a75f3","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-768f6a53aba918c8a59a75f3: start","job_status":"start","queue_duration_s":1.337092,"scheduling_latency_s":1.337109}1539gitlab # [ 303.471161] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.442Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"768f6a53aba918c8a59a75f3","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-768f6a53aba918c8a59a75f3: done: 0.014815 sec","job_status":"done","queue_duration_s":1.337092,"scheduling_latency_s":1.337109,"redis_calls":13,"redis_duration_s":0.0016589999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000561,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010225,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014815,"completed_at":"2026-09-03T10:18:04.442Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1540gitlab # [ 303.509084] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.443Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91730f52af6d9251b794b9b1","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91730f52af6d9251b794b9b1: start","job_status":"start","queue_duration_s":1.353073,"scheduling_latency_s":1.353089}1541gitlab # [ 303.521296] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.458Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91730f52af6d9251b794b9b1","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91730f52af6d9251b794b9b1: done: 0.014517 sec","job_status":"done","queue_duration_s":1.353073,"scheduling_latency_s":1.353089,"redis_calls":13,"redis_duration_s":0.001621,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000625,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000996,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009897,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014517,"completed_at":"2026-09-03T10:18:04.458Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1542gitlab # [ 303.558971] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.459Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8dda38f20ef4574a595e236","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8dda38f20ef4574a595e236: start","job_status":"start","queue_duration_s":1.36881,"scheduling_latency_s":1.368828}1543gitlab # [ 303.571028] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.473Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8dda38f20ef4574a595e236","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8dda38f20ef4574a595e236: done: 0.013948 sec","job_status":"done","queue_duration_s":1.36881,"scheduling_latency_s":1.368828,"redis_calls":13,"redis_duration_s":0.0015530000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00059,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000963,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009691,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013948,"completed_at":"2026-09-03T10:18:04.473Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1544gitlab # [ 303.610814] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.474Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d94ef16f5e65471a09c0a36","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d94ef16f5e65471a09c0a36: start","job_status":"start","queue_duration_s":1.383867,"scheduling_latency_s":1.383885}1545gitlab # [ 303.623235] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.488Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d94ef16f5e65471a09c0a36","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d94ef16f5e65471a09c0a36: done: 0.013751 sec","job_status":"done","queue_duration_s":1.383867,"scheduling_latency_s":1.383885,"redis_calls":13,"redis_duration_s":0.00141,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000901,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009406,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013751,"completed_at":"2026-09-03T10:18:04.488Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1546gitlab # [ 303.662038] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.489Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"408a70575a92f8a604e6b7a2","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-408a70575a92f8a604e6b7a2: start","job_status":"start","queue_duration_s":1.398686,"scheduling_latency_s":1.398704}1547gitlab # [ 303.674230] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.502Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"408a70575a92f8a604e6b7a2","created_at":"2026-09-03T10:18:02.948Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-f2de4fc216b04f42","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"58b655cf5be4b01bd25275ca10c29d2e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.090Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-408a70575a92f8a604e6b7a2: done: 0.013492 sec","job_status":"done","queue_duration_s":1.398686,"scheduling_latency_s":1.398704,"redis_calls":13,"redis_duration_s":0.0013930000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000875,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009296,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013492,"completed_at":"2026-09-03T10:18:04.502Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1548gitlab # [ 303.712322] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.504Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f312b939464413340f755ddb","created_at":"2026-09-03T10:18:03.224Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-afb196b7187e4300","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"1e1cf13a1de0d483a115a626b8c79757","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.239Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f312b939464413340f755ddb: start","job_status":"start","queue_duration_s":1.264934,"scheduling_latency_s":1.264952}1549gitlab # [ 303.724280] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.515Z","message":"No existing merge request to be cleaned up."}1550gitlab # [ 303.725923] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.524Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f312b939464413340f755ddb","created_at":"2026-09-03T10:18:03.224Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-afb196b7187e4300","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"1e1cf13a1de0d483a115a626b8c79757","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.239Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f312b939464413340f755ddb: done: 0.020296 sec","job_status":"done","queue_duration_s":1.264934,"scheduling_latency_s":1.264952,"redis_calls":10,"redis_duration_s":0.0012980000000000001,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00075,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013424,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020296,"completed_at":"2026-09-03T10:18:04.524Z","load_balancing_strategy":"primary","db_duration_s":0.003696,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1551gitlab # [ 303.763597] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.525Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9ea58ed36bb49a8b9a7c7fd0","created_at":"2026-09-03T10:18:03.224Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-afb196b7187e4300","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"1e1cf13a1de0d483a115a626b8c79757","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.239Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9ea58ed36bb49a8b9a7c7fd0: start","job_status":"start","queue_duration_s":1.286341,"scheduling_latency_s":1.286359}1552gitlab # [ 303.775703] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.536Z","message":"No existing merge request to be cleaned up."}1553gitlab # [ 303.777446] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.544Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9ea58ed36bb49a8b9a7c7fd0","created_at":"2026-09-03T10:18:03.224Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-afb196b7187e4300","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"1e1cf13a1de0d483a115a626b8c79757","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.239Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9ea58ed36bb49a8b9a7c7fd0: done: 0.018685 sec","job_status":"done","queue_duration_s":1.286341,"scheduling_latency_s":1.286359,"redis_calls":10,"redis_duration_s":0.001313,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000571,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000742,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012547,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018685,"completed_at":"2026-09-03T10:18:04.544Z","load_balancing_strategy":"primary","db_duration_s":0.002704,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1554gitlab # [ 303.816640] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.545Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5f062eec830b3e6cc06a81f9","created_at":"2026-09-03T10:18:03.224Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-afb196b7187e4300","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"1e1cf13a1de0d483a115a626b8c79757","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.239Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5f062eec830b3e6cc06a81f9: start","job_status":"start","queue_duration_s":1.306102,"scheduling_latency_s":1.306121}1555gitlab # [ 303.829216] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.555Z","message":"No existing merge request to be cleaned up."}1556gitlab # [ 303.830980] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.563Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5f062eec830b3e6cc06a81f9","created_at":"2026-09-03T10:18:03.224Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-afb196b7187e4300","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"1e1cf13a1de0d483a115a626b8c79757","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.239Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5f062eec830b3e6cc06a81f9: done: 0.018113 sec","job_status":"done","queue_duration_s":1.306102,"scheduling_latency_s":1.306121,"redis_calls":10,"redis_duration_s":0.001308,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000569,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000739,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012419,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018113,"completed_at":"2026-09-03T10:18:04.563Z","load_balancing_strategy":"primary","db_duration_s":0.002415,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1557gitlab # [ 303.870855] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.564Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"641e1f2cdc46ff02adc7458c","created_at":"2026-09-03T10:18:03.224Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-afb196b7187e4300","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"1e1cf13a1de0d483a115a626b8c79757","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.239Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-641e1f2cdc46ff02adc7458c: start","job_status":"start","queue_duration_s":1.325304,"scheduling_latency_s":1.325322}1558gitlab # [ 303.883722] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.574Z","message":"No existing merge request to be cleaned up."}1559gitlab # [ 303.885623] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:04.582Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"641e1f2cdc46ff02adc7458c","created_at":"2026-09-03T10:18:03.224Z","trace_propagation_headers":{"sentry-trace":"bc6b2bc061c54c7091b9da765daa2054-afb196b7187e4300","baggage":"sentry-trace_id=bc6b2bc061c54c7091b9da765daa2054,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"1e1cf13a1de0d483a115a626b8c79757","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:18:03.239Z","job_size_bytes":2,"pid":2141,"sidekiq_tid":"m7n9","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-641e1f2cdc46ff02adc7458c: done: 0.018061 sec","job_status":"done","queue_duration_s":1.325304,"scheduling_latency_s":1.325322,"redis_calls":10,"redis_duration_s":0.001376,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000582,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000794,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012412,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018061,"completed_at":"2026-09-03T10:18:04.582Z","load_balancing_strategy":"primary","db_duration_s":0.002411,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1560gitlab # [ 310.221384] redis[853]: 10 changes in 300 seconds. Saving...1561gitlab # [ 310.227076] redis[853]: Background saving started by pid 34141562gitlab # [ 310.231227] redis[3414]: BGSAVE done, 453 keys saved, 0 keys skipped, 117556 bytes written.1563gitlab # [ 310.236378] redis[3414]: DB saved on disk1564gitlab # [ 310.238634] redis[3414]: Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB1565gitlab # [ 310.322512] redis[853]: Background saving terminated with success1566gitlab # [ 311.352123] postgres[924]: [924] LOG: checkpoint starting: time1567gitlab # [ 312.859481] gitaly[961]: time="2026-09-03T10:18:15.727Z" level=info msg="burden monitor stats" pid=9611568gitlab # [ 327.711505] postgres[3464]: [3464] ERROR: relation "table_without_models" does not exist1569gitlab # [ 327.715492] postgres[3464]: [3464] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1570gitlab # [ 333.536501] runuser[3129]: pam_unix(runuser:session): session closed for user gitlab1571gitlab # [ 333.538435] setup-gitlab-start[3109]: + systemctl restart gitlab-sidekiq.service1572gitlab # [ 333.583488] systemd[1]: Stopping gitlab-sidekiq.service...1573gitlab # [ 333.587317] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:36.453Z","message":"Shutting down"}1574gitlab # [ 333.591773] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:36.453Z","message":"Scheduler exiting..."}1575gitlab # [ 333.596307] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:36.454Z","message":"Terminating quiet threads for default capsule"}1576gitlab # [ 333.601506] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:36.454Z","message":"Scheduler exiting..."}1577gitlab # [ 334.085602] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:36.956Z","message":"Pausing to allow jobs to finish..."}1578gitlab # [ 337.090977] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:39.960Z","message":"Bye!"}1579gitlab # [ 338.206761] sidekiq-cluster[2141]: {"severity":"INFO","time":"2026-09-03T10:18:41.076Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":2141,"worker_id":"sidekiq_0","memwd_rss_bytes":920354816,"retry":0}1580gitlab # [ 338.796361] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1581gitlab # [ 338.799422] systemd[1]: Stopped gitlab-sidekiq.service.1582gitlab # [ 338.801899] systemd[1]: gitlab-sidekiq.service: Consumed 1min 52.313s CPU time over 3min 27.421s wall clock time, 936.9M memory peak, 4.6M read from disk.1583gitlab # [ 338.807939] systemd[1]: Started gitlab-sidekiq.service.1584gitlab # [ 338.811560] setup-gitlab-start[3109]: + mkdir -p /var/lib/secrets1585gitlab # [ 338.817131] setup-gitlab-start[3109]: + echo nixbot-test-token-of-20-chars1586gitlab # [ 338.820354] setup-gitlab-start[3109]: + chmod 644 /var/lib/secrets/gitlab-token1587gitlab # [ 338.823304] setup-gitlab-start[3109]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1588gitlab # [ 340.317054] gitaly[961]: time="2026-09-03T10:18:43.187Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1KCE8NV1EPGQJNMCDY5ND96 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-03T10:18:53.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:18:43.185" pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1589gitlab # [ 340.320600] gitaly[961]: time="2026-09-03T10:18:43.187Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1KCE8NV1EPGQJNMCDY5ND96 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-03T10:18:53.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:18:43.185" grpc.time_ms=1.791 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1590gitlab # [ 340.595468] gitaly[961]: time="2026-09-03T10:18:43.466Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1KCE8NV1EPGQJNMCDY5ND96 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-03T10:18:53.284" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:18:43.465" pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1591gitlab # [ 340.656136] gitaly[961]: time="2026-09-03T10:18:43.466Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1KCE8NV1EPGQJNMCDY5ND96 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-03T10:18:53.284" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:18:43.465" grpc.time_ms=0.611 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1592gitlab # [ 340.711805] gitaly[961]: time="2026-09-03T10:18:43.582Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1KCE8NV1EPGQJNMCDY5ND96 diskcache=fed9fbdc-621f-471a-b97b-83fd45615a91 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-03T10:18:53.300" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:18:43.481" pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1593gitlab # [ 340.739363] gitaly[961]: time="2026-09-03T10:18:43.583Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=38 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1439 command.oublock=32 command.real_time_ms=77 command.spawn_token_fork_ms=7 command.system_time_ms=32 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCE8NV1EPGQJNMCDY5ND96 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-03T10:18:53.300" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:18:43.481" grpc.time_ms=101.687 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1594gitlab # [ 340.765527] gitaly[961]: time="2026-09-03T10:18:43.607Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M1KCE8NV1EPGQJNMCDY5ND96 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-03T10:18:53.005" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:18:43.606" pid=961 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1595gitlab # [ 340.784455] gitaly[961]: time="2026-09-03T10:18:43.608Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1KCE8NV1EPGQJNMCDY5ND96 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-03T10:18:53.005" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:18:43.606" grpc.time_ms=2.025 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1596gitlab # [ 340.802537] gitaly[961]: time="2026-09-03T10:18:43.636Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCE8NV1EPGQJNMCDY5ND96 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-03T10:18:53.016" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:18:43.617" grpc.time_ms=18.537 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1597gitlab # [ 340.880989] gitaly[961]: time="2026-09-03T10:18:43.751Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1KCE8NV1EPGQJNMCDY5ND96 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-03T10:18:53.150" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:18:43.751" pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1598gitlab # [ 340.911506] gitaly[961]: time="2026-09-03T10:18:43.752Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1KCE8NV1EPGQJNMCDY5ND96 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-03T10:18:53.150" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:18:43.751" grpc.time_ms=0.614 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1599gitlab # [ 340.943098] gitaly[961]: time="2026-09-03T10:18:43.798Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1KCE8NV1EPGQJNMCDY5ND96 diskcache=f621c303-5096-4a06-9934-c2e594334d35 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-03T10:18:53.154" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:18:43.755" pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1600gitlab # [ 340.965882] gitaly[961]: time="2026-09-03T10:18:43.798Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1436 command.oublock=32 command.real_time_ms=22 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=9 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCE8NV1EPGQJNMCDY5ND96 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-03T10:18:53.154" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:18:43.755" grpc.time_ms=43.1 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1601gitlab # [ 340.993158] gitaly[961]: time="2026-09-03T10:18:43.807Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M1KCE8NV1EPGQJNMCDY5ND96 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-03T10:18:53.205" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:18:43.806" pid=961 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1602gitlab # [ 341.011246] gitaly[961]: time="2026-09-03T10:18:43.808Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1KCE8NV1EPGQJNMCDY5ND96 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-03T10:18:53.205" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:18:43.806" grpc.time_ms=1.935 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1603gitlab # [ 341.027446] gitaly[961]: time="2026-09-03T10:18:43.828Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=4 command.system_time_ms=8 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCE8NV1EPGQJNMCDY5ND96 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-03T10:18:53.212" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:18:43.812" grpc.time_ms=15.883 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1604gitlab # [ 341.045525] gitaly[961]: time="2026-09-03T10:18:43.875Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1KCE8NV1EPGQJNMCDY5ND96 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-03T10:18:53.274" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:18:43.875" grpc.time_ms=0.217 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1605gitlab # [ 341.058265] gitaly[961]: time="2026-09-03T10:18:43.888Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1KCE8NV1EPGQJNMCDY5ND96 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-03T10:18:53.285" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:18:43.886" grpc.time_ms=0.919 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1606gitlab # [ 341.826900] gitaly[961]: time="2026-09-03T10:18:44.697Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCE8NV1EPGQJNMCDY5ND96 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-03T10:18:54.078" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:18:44.679" grpc.time_ms=17.591 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1607gitlab # [ 342.496166] gitlab-workhorse[891]: gitlab 2001:db8:1::1 - - [2026/09/03:10:18:45 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 36421608gitlab # [ 342.497892] setup-gitlab-start[3109]: + mkdir -p /tmp/test-flake1609gitlab # [ 342.505059] setup-gitlab-start[3109]: + cd /tmp/test-flake1610gitlab # [ 342.510084] setup-gitlab-start[3109]: + git init -b master1611gitlab # [ 342.528220] setup-gitlab-start[3587]: Initialized empty Git repository in /tmp/test-flake/.git/1612gitlab # [ 342.531703] setup-gitlab-start[3109]: + git config user.name test1613gitlab # [ 342.534948] setup-gitlab-start[3109]: + git config user.email test@example.com1614gitlab # [ 342.541861] setup-gitlab-start[3109]: + cat1615gitlab # [ 342.547297] setup-gitlab-start[3109]: + git add flake.nix1616gitlab # [ 342.555873] setup-gitlab-start[3109]: + git commit -m 'initial commit'1617gitlab # [ 342.590898] setup-gitlab-start[3592]: [master (root-commit) f8d9413] initial commit1618gitlab # [ 342.593867] setup-gitlab-start[3592]: 1 file changed, 10 insertions(+)1619gitlab # [ 342.595744] setup-gitlab-start[3592]: create mode 100644 flake.nix1620gitlab # [ 342.597614] setup-gitlab-start[3109]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1621gitlab # [ 342.605522] setup-gitlab-start[3109]: + git push -u origin master1622gitlab # [ 342.742787] gitlab-workhorse[891]: gitlab 2001:db8:1::1 - - [2026/09/03:10:18:45 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 851623gitlab # [ 343.358386] gitaly[961]: time="2026-09-03T10:18:46.228Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KCECFFEYE1Q6KJ48D0CFSR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:18:46.211" grpc.time_ms=16.561 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1624gitlab # [ 343.395990] gitlab-workhorse[891]: gitlab 2001:db8:1::1 - - [2026/09/03:10:18:46 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 6131625gitlab # [ 343.805664] gitaly[961]: time="2026-09-03T10:18:46.675Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCED4C8518EKJMWNNH708R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-03T10:18:56.059" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:18:46.660" grpc.time_ms=15.317 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1626gitlab # [ 343.877131] gitaly[961]: time="2026-09-03T10:18:46.747Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=3 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KCED4C8518EKJMWNNH708R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-03T10:19:16.027" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-03T10:18:46.727" grpc.time_ms=20.019 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1627gitlab # [ 343.916008] gitaly[961]: time="2026-09-03T10:18:46.784Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M1KCED4C8518EKJMWNNH708R duration_ms=258ns method=POST pid=961 status=200 url="http://unix/api/v4/internal/allowed"1628gitlab # [ 343.934428] sidekiq-cluster[3531]: {"severity":"INFO","time":"2026-09-03T10:18:46.775Z","message":"Starting cluster with 1 processes"}1629gitlab # [ 344.056330] gitaly[961]: time="2026-09-03T10:18:46.927Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M1KCED4C8518EKJMWNNH708R duration_ms=141ns method=POST pid=961 status=200 url="http://unix/api/v4/internal/pre_receive"1630gitlab # [ 344.059282] gitaly[961]: time="2026-09-03T10:18:46.927Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KCED4C8518EKJMWNNH708R grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5315 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:18:46.523" grpc.time_ms=404.225 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1631gitlab # [ 344.120406] gitaly[961]: time="2026-09-03T10:18:46.991Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KCED4C8518EKJMWNNH708R grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:18:46.988" grpc.time_ms=2.313 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1632gitlab # [ 344.184575] gitaly[961]: time="2026-09-03T10:18:47.054Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KCED4C8518EKJMWNNH708R grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4784 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:18:47.053" grpc.time_ms=1.264 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1633gitlab # [ 344.265510] gitaly[961]: time="2026-09-03T10:18:47.136Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KCED4C8518EKJMWNNH708R grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:18:47.134" grpc.time_ms=1.379 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1634gitlab # [ 344.528175] gitaly[961]: time="2026-09-03T10:18:47.398Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCED4C8518EKJMWNNH708R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-03T10:18:57.009" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:18:47.380" grpc.time_ms=17.692 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1635gitlab # [ 344.590680] gitaly[961]: time="2026-09-03T10:18:47.461Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=28 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1435 command.oublock=0 command.real_time_ms=36 command.spawn_token_fork_ms=9 command.system_time_ms=21 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCED4C8518EKJMWNNH708R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-03T10:18:57.047" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:18:47.418" grpc.time_ms=42.104 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1636gitlab # [ 344.631514] gitaly[961]: time="2026-09-03T10:18:47.502Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M1KCED4C8518EKJMWNNH708R duration_ms=312ns method=POST pid=961 status=200 url="http://unix/api/v4/internal/post_receive"1637gitlab # [ 344.637907] gitaly[961]: time="2026-09-03T10:18:47.508Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KCED4C8518EKJMWNNH708R grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4809 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:18:47.188" grpc.time_ms=320.375 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1638gitlab # [ 344.662723] gitaly[961]: time="2026-09-03T10:18:47.533Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M1KCED4C8518EKJMWNNH708R diskcache=ee71df34-ac9f-44e3-8887-cba605d5389d grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:18:46.413" pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1639gitlab # [ 344.693008] gitaly[961]: time="2026-09-03T10:18:47.533Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=364 command.inblock=8 command.majflt=0 command.maxrssanon_bytes=851968 command.minflt=13553 command.oublock=32 command.real_time_ms=1110 command.spawn_token_fork_ms=2 command.system_time_ms=209 command.user_time_ms=155 component=gitaly.StreamServerInterceptor correlation_id=01M1KCED4C8518EKJMWNNH708R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:18:46.413" grpc.time_ms=1119.73 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1640gitlab # [ 344.722460] systemd[1]: Finished setup-gitlab.service.1641gitlab # [ 344.724126] setup-gitlab-start[3596]: To http://gitlab/root/test-flake.git1642gitlab # [ 344.725685] setup-gitlab-start[3596]: * [new branch] master -> master1643gitlab # [ 344.727215] setup-gitlab-start[3596]: branch 'master' set up to track 'origin/master'.1644gitlab # [ 344.729568] gitlab-workhorse[891]: time="2026-09-03T10:18:47Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521645gitlab # [ 344.732441] gitlab-workhorse[891]: gitlab 2001:db8:1::1 - - [2026/09/03:10:18:47 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 12491646gitlab # [ 344.735214] systemd[1]: Starting nixbot CI service...1647gitlab: (finished: waiting for unit setup-gitlab.service, in 346.29 seconds)1648gitlab: waiting for unit nixbot.service1649gitlab # [ 346.089268] nixbot[3692]: {"ts": "2026-09-03T10:18:48.958Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1650gitlab # [ 346.131220] nixbot[3692]: {"ts": "2026-09-03T10:18:49.001Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1651gitlab # [ 346.171275] nixbot[3692]: {"ts": "2026-09-03T10:18:49.041Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1652gitlab # [ 346.178222] nixbot[3692]: {"ts": "2026-09-03T10:18:49.048Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1653gitlab # [ 346.184964] nixbot[3692]: {"ts": "2026-09-03T10:18:49.055Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1654gitlab # [ 346.195606] nixbot[3692]: {"ts": "2026-09-03T10:18:49.066Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1655gitlab # [ 346.202260] nixbot[3692]: {"ts": "2026-09-03T10:18:49.072Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1656gitlab # [ 346.208939] nixbot[3692]: {"ts": "2026-09-03T10:18:49.075Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1657gitlab # [ 346.215708] nixbot[3692]: {"ts": "2026-09-03T10:18:49.085Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1658gitlab # [ 346.222983] nixbot[3692]: {"ts": "2026-09-03T10:18:49.088Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1659gitlab # [ 346.229852] nixbot[3692]: {"ts": "2026-09-03T10:18:49.097Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1660gitlab # [ 346.236934] nixbot[3692]: {"ts": "2026-09-03T10:18:49.107Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1661gitlab # [ 346.243485] nixbot[3692]: {"ts": "2026-09-03T10:18:49.112Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1662gitlab # [ 346.250331] nixbot[3692]: {"ts": "2026-09-03T10:18:49.116Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1663gitlab # [ 346.256741] nixbot[3692]: {"ts": "2026-09-03T10:18:49.123Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1664gitlab # [ 346.264204] nixbot[3692]: {"ts": "2026-09-03T10:18:49.126Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1665gitlab # [ 346.270156] nixbot[3692]: {"ts": "2026-09-03T10:18:49.128Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1666gitlab # [ 346.276242] nixbot[3692]: {"ts": "2026-09-03T10:18:49.131Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1667gitlab # [ 346.281323] nixbot[3692]: {"ts": "2026-09-03T10:18:49.140Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1668gitlab # [ 346.286572] nixbot[3692]: {"ts": "2026-09-03T10:18:49.143Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1669gitlab # [ 346.291940] nixbot[3692]: {"ts": "2026-09-03T10:18:49.146Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1670gitlab # [ 346.297118] nixbot[3692]: {"ts": "2026-09-03T10:18:49.156Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1671gitlab # [ 346.302259] nixbot[3692]: {"ts": "2026-09-03T10:18:49.159Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1672gitlab # [ 346.307067] nixbot[3692]: {"ts": "2026-09-03T10:18:49.162Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1673gitlab # [ 346.311544] nixbot[3692]: {"ts": "2026-09-03T10:18:49.164Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1674gitlab # [ 346.315980] nixbot[3692]: {"ts": "2026-09-03T10:18:49.168Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"}1675gitlab # [ 346.320000] nixbot[3692]: {"ts": "2026-09-03T10:18:49.171Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"}1676gitlab # [ 346.324154] nixbot[3692]: {"ts": "2026-09-03T10:18:49.173Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"}1677gitlab # [ 346.723557] nixbot[3692]: INFO: Started server process [3692]1678gitlab # [ 346.726427] nixbot[3692]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1679gitlab # [ 346.746031] nixbot[3692]: INFO: ::ffff:127.0.0.1:35338 - "GET /health HTTP/1.1" 200 OK1680gitlab # [ 346.757604] systemd[1]: Started nixbot CI service.1681gitlab # [ 346.761092] systemd[1]: Reached target Multi-User System.1682gitlab # [ 346.763538] systemd[1]: Startup finished in 735ms (kernel) + 4.380s (initrd) + 5min 41.643s (userspace) = 5min 46.758s.1683gitlab: (finished: waiting for unit nixbot.service, in 1.10 seconds)1684gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1685gitlab # [ 346.988960] nixbot[3692]: INFO: ::ffff:127.0.0.1:35340 - "GET /health HTTP/1.1" 200 OK1686gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.05 seconds)1687subtest: project discovered and webhook registered1688gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1689gitlab # [ 347.139822] gitlab-workhorse[891]: gitlab 2001:db8:1::1 - - [2026/09/03:10:18:50 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 3931690gitlab # [ 347.142872] nixbot[3692]: {"ts": "2026-09-03T10:18:50.012Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1691gitlab # [ 347.169225] nixbot[3692]: {"ts": "2026-09-03T10:18:50.039Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1692gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.21 seconds)1693gitlab # [ 347.205345] gitlab-workhorse[891]: gitlab 2001:db8:1::1 - - [2026/09/03:10:18:50 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 1651694gitlab # [ 347.248283] gitlab-workhorse[891]: gitlab 2001:db8:1::1 - - [2026/09/03:10:18:50 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 641695gitlab # [ 347.250533] nixbot[3692]: {"ts": "2026-09-03T10:18:50.121Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1696gitlab # [ 347.254224] nixbot[3692]: {"ts": "2026-09-03T10:18:50.124Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1697gitlab # [ 347.553398] gitlab-workhorse[891]: gitlab 2001:db8:1::1 - - [2026/09/03:10:18:50 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 2941698gitlab # [ 347.560239] nixbot[3692]: {"ts": "2026-09-03T10:18:50.425Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1699gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1700gitlab # [ 348.481971] gitlab-workhorse[891]: gitlab 2001:db8:1::1 - - [2026/09/03:10:18:51 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 2111701gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.28 seconds)1702(finished: subtest: project discovered and webhook registered, in 1.49 seconds)1703subtest: push delivers the webhook1704gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1705gitlab # [ 348.635880] gitlab-workhorse[891]: gitlab 2001:db8:1::1 - - [2026/09/03:10:18:51 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 631706gitlab # [ 348.823097] gitaly[961]: time="2026-09-03T10:18:51.693Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1KCEJ7MDSTPDMG31FH967X7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:18:51.678" grpc.time_ms=14.368 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1707gitlab # [ 348.843635] gitlab-workhorse[891]: gitlab 2001:db8:1::1 - - [2026/09/03:10:18:51 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 1861708gitlab # Enumerating objects: 5, done.1709gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1710gitlab # Delta compression using up to 4 threads1711gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1712gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 274 bytes | 68.00 KiB/s, done.1713gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1714gitlab # [ 349.247050] gitaly[961]: time="2026-09-03T10:18:52.117Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=302 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=6 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KCEJEZERFFYK5VV31QN2M5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-03T10:19:22.005" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-03T10:18:52.106" grpc.time_ms=11.622 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1715gitlab # [ 349.290120] gitaly[961]: time="2026-09-03T10:18:52.132Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M1KCEJEZERFFYK5VV31QN2M5 duration_ms=110ns method=POST pid=961 status=200 url="http://unix/api/v4/internal/allowed"1716gitlab # [ 349.304067] gitaly[961]: time="2026-09-03T10:18:52.174Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M1KCEJEZERFFYK5VV31QN2M5 duration_ms=41ns method=POST pid=961 status=200 url="http://unix/api/v4/internal/pre_receive"1717gitlab # [ 349.308025] gitaly[961]: time="2026-09-03T10:18:52.175Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KCEJEZERFFYK5VV31QN2M5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5315 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:18:52.020" grpc.time_ms=155.13 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1718gitlab # [ 349.351176] gitaly[961]: time="2026-09-03T10:18:52.221Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KCEJEZERFFYK5VV31QN2M5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:18:52.220" grpc.time_ms=0.906 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1719gitlab # [ 349.398159] gitaly[961]: time="2026-09-03T10:18:52.268Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KCEJEZERFFYK5VV31QN2M5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4784 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:18:52.268" grpc.time_ms=0.747 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1720gitlab # [ 349.440886] gitaly[961]: time="2026-09-03T10:18:52.311Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KCEJEZERFFYK5VV31QN2M5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:18:52.310" grpc.time_ms=1.224 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1721gitlab # [ 349.543511] gitlab-workhorse[891]: gitlab 2001:db8:1::1 - - [2026/09/03:10:18:52 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 19681722gitlab # [ 349.546424] nixbot[3692]: {"ts": "2026-09-03T10:18:52.416Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1723gitlab # [ 349.551123] gitaly[961]: time="2026-09-03T10:18:52.421Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M1KCEJEZERFFYK5VV31QN2M5 duration_ms=71ns method=POST pid=961 status=200 url="http://unix/api/v4/internal/post_receive"1724gitlab # [ 349.555721] gitaly[961]: time="2026-09-03T10:18:52.422Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KCEJEZERFFYK5VV31QN2M5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4809 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:18:52.348" grpc.time_ms=74.111 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1725gitlab # [ 349.567568] gitaly[961]: time="2026-09-03T10:18:52.437Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M1KCEJEZERFFYK5VV31QN2M5 diskcache=a2c4efaa-b06e-42cf-bc37-7eb00479de55 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:18:51.906" pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1726gitlab # To http://gitlab/root/test-flake.git1727gitlab # [ 349.577872] gitlab-workhorse[891]: time="2026-09-03T10:18:52Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521728gitlab # f8d9413..355840b [ 349.580968] gitlab-workhorse[891]: gitlab 2001:db8:1::1 - - [2026/09/03:10:18:52 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 6941729gitlab # master -> master[ 349.583513] gitaly[961]: time="2026-09-03T10:18:52.437Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=262 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=851968 command.minflt=13601 command.oublock=32 command.real_time_ms=523 command.spawn_token_fork_ms=4 command.system_time_ms=150 command.user_time_ms=112 component=gitaly.StreamServerInterceptor correlation_id=01M1KCEJEZERFFYK5VV31QN2M5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=606 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:18:51.906" grpc.time_ms=531.029 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1730gitlab # 1731gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 1.12 seconds)1732gitlab: must succeed: git -C /tmp/test-flake rev-parse master1733gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds)1734gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=355840ba9dedee876dcb3d79810f29ba69997a3c'1735gitlab # [ 349.695011] nixbot[3692]: INFO: ::ffff:127.0.0.1:35346 - "GET /api/repos/gitlab/root/test-flake/builds?commit=355840ba9dedee876dcb3d79810f29ba69997a3c HTTP/1.1" 200 OK1736gitlab # [ 349.704586] gitlab-workhorse[891]: gitlab 2001:db8:1::1 - - [2026/09/03:10:18:52 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 1441737gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=355840ba9dedee876dcb3d79810f29ba69997a3c', in 0.08 seconds)1738gitlab # [ 349.708197] nixbot[3692]: {"ts": "2026-09-03T10:18:52.578Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1739gitlab # [ 349.789980] gitlab-workhorse[891]: gitlab 2001:db8:1::1 - - [2026/09/03:10:18:52 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 771740gitlab # [ 349.796240] nixbot[3692]: {"ts": "2026-09-03T10:18:52.661Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1741gitlab # [ 349.871031] gitaly[961]: time="2026-09-03T10:18:52.740Z" level=info msg="finished unary call with code OK" catfile.duration_ms=8 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=8 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCEKBV7MF6ACR848AK34GE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-09-03T10:19:22.020" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=255 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:18:52.721" grpc.time_ms=18.801 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1742gitlab # [ 349.932501] gitaly[961]: time="2026-09-03T10:18:52.803Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCEKBV7MF6ACR848AK34GE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:19:22.100" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:18:52.801" grpc.time_ms=1.353 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1743gitlab # [ 349.968688] gitaly[961]: time="2026-09-03T10:18:52.826Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=8 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCEKBV7MF6ACR848AK34GE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-09-03T10:19:02.209" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:18:52.810" grpc.time_ms=15.589 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1744gitlab # [ 350.010653] gitlab-workhorse[891]: gitlab 2001:db8:1::1 - - [2026/09/03:10:18:52 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 772 "" "python-httpx/0.28.1" 2131745gitlab # [ 350.018147] nixbot[3692]: {"ts": "2026-09-03T10:18:52.883Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1746gitlab # [ 350.251022] gitlab-workhorse[891]: gitlab 2001:db8:1::1 - - [2026/09/03:10:18:53 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 2301747gitlab # [ 350.258712] nixbot[3692]: {"ts": "2026-09-03T10:18:53.122Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1748gitlab # [ 350.266894] nixbot[3692]: {"ts": "2026-09-03T10:18:53.127Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1749gitlab # [ 350.459110] gitaly[961]: time="2026-09-03T10:18:53.329Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KCEKVZEKDGTBW8DY9WJQQ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:18:53.311" grpc.time_ms=18.187 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc1750gitlab # [ 350.496774] gitlab-workhorse[891]: gitlab 2001:db8:1::1 - - [2026/09/03:10:18:53 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1481751gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=355840ba9dedee876dcb3d79810f29ba69997a3c'1752gitlab # [ 350.695916] gitaly[961]: time="2026-09-03T10:18:53.566Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1KCEM0NG36M30NKQ87YWYVX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:18:53.545" pid=961 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc1753gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=355840ba9dedee876dcb3d79810f29ba69997a3c', in 0.05 seconds)1754gitlab # [ 350.726733] gitaly[961]: time="2026-09-03T10:18:53.566Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=1 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCEM0NG36M30NKQ87YWYVX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:18:53.545" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc1755gitlab # [ 350.762657] gitlab-workhorse[891]: time="2026-09-03T10:18:53Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1131756gitlab # [ 350.766867] gitlab-workhorse[891]: gitlab 2001:db8:1::1 - - [2026/09/03:10:18:53 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 2341757gitlab # [ 350.771744] nixbot[3692]: INFO: ::ffff:127.0.0.1:35362 - "GET /api/repos/gitlab/root/test-flake/builds?commit=355840ba9dedee876dcb3d79810f29ba69997a3c HTTP/1.1" 200 OK1758gitlab # [ 350.776169] gitaly[961]: time="2026-09-03T10:18:53.567Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=1 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCEM0NG36M30NKQ87YWYVX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:18:53.545" grpc.time_ms=21.149 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc1759gitlab # [ 350.932797] gitaly[961]: time="2026-09-03T10:18:53.802Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1KCEMA1S3ADRSRFCBQ7TBB1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:18:53.767" pid=961 remote_ip="2001:db8:1::1" request_sha=307cbd73db52ded4d1af99e982c0845ca5b556e7 response_bytes=418 span.kind=server system=grpc1760gitlab # [ 350.957448] gitaly[961]: time="2026-09-03T10:18:53.802Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=30 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1132 command.oublock=0 command.real_time_ms=32 command.spawn_token_fork_ms=2 command.system_time_ms=27 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCEMA1S3ADRSRFCBQ7TBB1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:18:53.767" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc1761gitlab # [ 350.985299] gitlab-workhorse[891]: time="2026-09-03T10:18:53Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=4181762gitlab # [ 350.989604] gitlab-workhorse[891]: gitlab 2001:db8:1::1 - - [2026/09/03:10:18:53 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 418 "" "git/2.55.0" 1701763gitlab # [ 350.992856] gitaly[961]: time="2026-09-03T10:18:53.803Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=30 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1132 command.oublock=0 command.real_time_ms=32 command.spawn_token_fork_ms=2 command.system_time_ms=27 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCEMA1S3ADRSRFCBQ7TBB1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:18:53.767" grpc.time_ms=36.094 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc1764gitlab # [ 351.108478] gitaly[961]: time="2026-09-03T10:18:53.979Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01M1KCEMHFYRN9ZP32SQ4XW0T1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:18:53.962" grpc.time_ms=16.073 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc1765gitlab # [ 351.146364] gitlab-workhorse[891]: gitlab 2001:db8:1::1 - - [2026/09/03:10:18:53 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1081766gitlab # [ 351.271479] gitaly[961]: time="2026-09-03T10:18:54.142Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1KCEMMYKXPN07357YZ33YFH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:18:54.121" pid=961 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1767gitlab # [ 351.301586] gitaly[961]: time="2026-09-03T10:18:54.142Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=8 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCEMMYKXPN07357YZ33YFH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:18:54.121" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc1768gitlab # [ 351.329428] gitlab-workhorse[891]: time="2026-09-03T10:18:54Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671769gitlab # [ 351.332931] gitlab-workhorse[891]: gitlab 2001:db8:1::1 - - [2026/09/03:10:18:54 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1601770gitlab # [ 351.336050] gitaly[961]: time="2026-09-03T10:18:54.142Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=8 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCEMMYKXPN07357YZ33YFH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:18:54.121" grpc.time_ms=21.125 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc1771gitlab # [ 351.509842] gitaly[961]: time="2026-09-03T10:18:54.380Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KCEMWN2HVZ2ZX4D08NWTX1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:18:54.363" grpc.time_ms=17.041 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc1772gitlab # [ 351.549053] gitlab-workhorse[891]: gitlab 2001:db8:1::1 - - [2026/09/03:10:18:54 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1511773gitlab # [ 351.688858] gitaly[961]: time="2026-09-03T10:18:54.559Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1KCEN1F9NB4M3CERHP2JSEY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:18:54.526" pid=961 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc1774gitlab # [ 351.720923] gitaly[961]: time="2026-09-03T10:18:54.559Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=27 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1100 command.oublock=0 command.real_time_ms=29 command.spawn_token_fork_ms=2 command.system_time_ms=17 command.user_time_ms=10 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCEN1F9NB4M3CERHP2JSEY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:18:54.526" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc1775gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=355840ba9dedee876dcb3d79810f29ba69997a3c'1776gitlab # [ 351.755229] gitlab-workhorse[891]: time="2026-09-03T10:18:54Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2161777gitlab # [ 351.759176] gitlab-workhorse[891]: gitlab 2001:db8:1::1 - - [2026/09/03:10:18:54 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 1761778gitlab # [ 351.762849] gitaly[961]: time="2026-09-03T10:18:54.560Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=27 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1100 command.oublock=0 command.real_time_ms=29 command.spawn_token_fork_ms=2 command.system_time_ms=17 command.user_time_ms=10 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCEN1F9NB4M3CERHP2JSEY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:18:54.526" grpc.time_ms=33.611 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc1779gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=355840ba9dedee876dcb3d79810f29ba69997a3c', in 0.09 seconds)1780(finished: subtest: push delivers the webhook, in 3.35 seconds)1781subtest: eval and build post commit statuses1782gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/355840ba9dedee876dcb3d79810f29ba69997a3c/statuses1783gitlab # [ 351.836117] nixbot[3692]: INFO: ::ffff:127.0.0.1:39304 - "GET /api/repos/gitlab/root/test-flake/builds?commit=355840ba9dedee876dcb3d79810f29ba69997a3c HTTP/1.1" 200 OK1784gitlab # [ 351.929028] gitaly[961]: time="2026-09-03T10:18:54.799Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCEN8EY5PGHYYQH04W7M1N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:19:24.097" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:18:54.798" grpc.time_ms=1.054 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1785gitlab # [ 351.969163] gitaly[961]: time="2026-09-03T10:18:54.838Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCEND7S9ZFCYRAX81X69BT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:19:24.136" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:18:54.837" grpc.time_ms=1.048 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1786gitlab # [ 352.046997] gitaly[961]: time="2026-09-03T10:18:54.917Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=591 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KCEN8EY5PGHYYQH04W7M1N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-03T10:19:24.203" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:18:54.904" grpc.time_ms=13.574 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1787gitlab # [ 352.072399] gitlab-workhorse[891]: gitlab 2001:db8:1::1 - - [2026/09/03:10:18:54 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/355840ba9dedee876dcb3d79810f29ba69997a3c/statuses HTTP/1.1" 200 2 "" "curl/8.21.0" 1821788gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/355840ba9dedee876dcb3d79810f29ba69997a3c/statuses, in 0.24 seconds)1789gitlab # [ 352.106399] gitaly[961]: time="2026-09-03T10:18:54.977Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KCEN8EY5PGHYYQH04W7M1N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-03T10:19:04.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:18:54.964" grpc.time_ms=11.943 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1790gitlab # [ 352.263809] gitaly[961]: time="2026-09-03T10:18:55.134Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M1KCEN8EY5PGHYYQH04W7M1N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-03T10:19:05.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:18:55.118" grpc.time_ms=16.038 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1791gitlab # [ 352.456872] gitaly[961]: time="2026-09-03T10:18:55.327Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1KCEN8EY5PGHYYQH04W7M1N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-03T10:19:05.215" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:18:55.326" grpc.time_ms=0.813 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1792gitlab # [ 352.496542] gitaly[961]: time="2026-09-03T10:18:55.367Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCEN8EY5PGHYYQH04W7M1N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-03T10:19:05.237" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:18:55.348" grpc.time_ms=18.103 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1793gitlab # [ 352.574593] gitaly[961]: time="2026-09-03T10:18:55.445Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KCEN8EY5PGHYYQH04W7M1N grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4153 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:18:55.442" grpc.time_ms=1.423 pid=961 span.kind=server system=grpc1794gitlab # [ 352.627287] gitaly[961]: time="2026-09-03T10:18:55.498Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KCEN8EY5PGHYYQH04W7M1N grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:18:55.496" grpc.time_ms=0.961 pid=961 span.kind=server system=grpc1795gitlab # [ 352.666521] gitaly[961]: time="2026-09-03T10:18:55.537Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1KCEN8EY5PGHYYQH04W7M1N diskcache=95fa1cbc-ceae-4771-9367-aa1ed4c8f845 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-03T10:19:05.002" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:18:55.373" pid=961 ref=refs/keep-around/355840ba9dedee876dcb3d79810f29ba69997a3c remote_ip="2001:db8:1::1" revision=355840ba9dedee876dcb3d79810f29ba69997a3c span.kind=server system=grpc username=root1796gitlab # [ 352.697451] gitaly[961]: time="2026-09-03T10:18:55.537Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=119 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5029 command.oublock=8 command.real_time_ms=154 command.spawn_token_fork_ms=2 command.system_time_ms=51 command.user_time_ms=68 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCEN8EY5PGHYYQH04W7M1N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-03T10:19:05.002" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:18:55.373" grpc.time_ms=164.11 pid=961 ref=refs/keep-around/355840ba9dedee876dcb3d79810f29ba69997a3c remote_ip="2001:db8:1::1" revision=355840ba9dedee876dcb3d79810f29ba69997a3c span.kind=server system=grpc username=root1797gitlab # [ 352.723845] gitaly[961]: time="2026-09-03T10:18:55.546Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCEN8EY5PGHYYQH04W7M1N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:19:25.044" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:18:55.545" grpc.time_ms=0.84 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1798gitlab # [ 353.026108] gitlab-workhorse[891]: gitlab 2001:db8:1::1 - - [2026/09/03:10:18:55 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/355840ba9dedee876dcb3d79810f29ba69997a3c HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 12891799gitlab # [ 353.034612] nixbot[3692]: {"ts": "2026-09-03T10:18:55.897Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/355840ba9dedee876dcb3d79810f29ba69997a3c \"HTTP/1.1 201 Created\""}1800gitlab # [ 353.045989] nixbot[3692]: {"ts": "2026-09-03T10:18:55.916Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-355840ba9ded-0"}1801gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/355840ba9dedee876dcb3d79810f29ba69997a3c/statuses1802gitlab # [ 353.281087] gitaly[961]: time="2026-09-03T10:18:56.145Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCEPM8RGGETMMHHAVXYVDA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:19:26.043" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:18:56.143" grpc.time_ms=0.953 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1803gitlab # [ 353.355716] nixbot[3692]: {"ts": "2026-09-03T10:18:56.226Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-355840ba9ded-0", "argv0": "bwrap"}1804gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/355840ba9dedee876dcb3d79810f29ba69997a3c/statuses, in 0.31 seconds)1805gitlab # [ 353.390091] gitlab-workhorse[891]: gitlab 2001:db8:1::1 - - [2026/09/03:10:18:56 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/355840ba9dedee876dcb3d79810f29ba69997a3c/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 2501806gitlab # [ 353.541133] systemd[1]: Started Nix Daemon.1807gitlab # [ 353.661911] nix-daemon[3929]: accepted connection from pid 3924, user nixbot1808gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/355840ba9dedee876dcb3d79810f29ba69997a3c/statuses1809gitlab # [ 354.553881] gitaly[961]: time="2026-09-03T10:18:57.423Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCEQX45ASEBS1SC0W9NZTA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:19:27.321" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:18:57.421" grpc.time_ms=1.373 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1810gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/355840ba9dedee876dcb3d79810f29ba69997a3c/statuses, in 0.25 seconds)1811gitlab # [ 354.641525] gitlab-workhorse[891]: gitlab 2001:db8:1::1 - - [2026/09/03:10:18:57 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/355840ba9dedee876dcb3d79810f29ba69997a3c/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1941812gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/355840ba9dedee876dcb3d79810f29ba69997a3c/statuses1813gitlab # [ 355.948938] gitaly[961]: time="2026-09-03T10:18:58.819Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCES4DZ09EVGJVXSAWS1BM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:19:28.116" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:18:58.817" grpc.time_ms=1.335 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1814gitlab # [ 356.078943] gitlab-workhorse[891]: gitlab 2001:db8:1::1 - - [2026/09/03:10:18:58 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/355840ba9dedee876dcb3d79810f29ba69997a3c/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 3751815gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/355840ba9dedee876dcb3d79810f29ba69997a3c/statuses, in 0.43 seconds)1816gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/355840ba9dedee876dcb3d79810f29ba69997a3c/statuses1817gitlab # [ 357.244314] gitaly[961]: time="2026-09-03T10:19:00.113Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCETH5TB8K4GS4Z3SQQT8T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:19:30.011" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:19:00.112" grpc.time_ms=1.222 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1818gitlab # [ 357.294258] gitlab-workhorse[891]: gitlab 2001:db8:1::1 - - [2026/09/03:10:19:00 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/355840ba9dedee876dcb3d79810f29ba69997a3c/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1581819gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/355840ba9dedee876dcb3d79810f29ba69997a3c/statuses, in 0.21 seconds)1820gitlab # [ 358.269281] nix-daemon[3929]: accepted connection from pid 3963, user nixbot1821gitlab # [ 358.295488] nix-daemon[3929]: accepted connection from pid 3924, user nixbot1822gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/355840ba9dedee876dcb3d79810f29ba69997a3c/statuses1823gitlab # [ 358.444288] gitaly[961]: time="2026-09-03T10:19:01.314Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCEVQ2CSFJ620Z3K5N4Y0X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:19:31.211" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:19:01.312" grpc.time_ms=1.164 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1824gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/355840ba9dedee876dcb3d79810f29ba69997a3c/statuses, in 0.21 seconds)1825gitlab # [ 358.502918] gitlab-workhorse[891]: gitlab 2001:db8:1::1 - - [2026/09/03:10:19:01 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/355840ba9dedee876dcb3d79810f29ba69997a3c/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1531826gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/355840ba9dedee876dcb3d79810f29ba69997a3c/statuses1827gitlab # [ 359.671174] gitaly[961]: time="2026-09-03T10:19:02.540Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCEWWXA6QTD32SZP3ED5RN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:19:32.438" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:19:02.539" grpc.time_ms=1.329 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1828gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/355840ba9dedee876dcb3d79810f29ba69997a3c/statuses, in 0.22 seconds)1829gitlab # [ 359.728088] gitlab-workhorse[891]: gitlab 2001:db8:1::1 - - [2026/09/03:10:19:02 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/355840ba9dedee876dcb3d79810f29ba69997a3c/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1681830gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/355840ba9dedee876dcb3d79810f29ba69997a3c/statuses1831gitlab # [ 360.888661] gitaly[961]: time="2026-09-03T10:19:03.758Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCEY38V6XQASAKNE1MYQJZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:19:33.655" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:19:03.756" grpc.time_ms=1.242 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1832gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/355840ba9dedee876dcb3d79810f29ba69997a3c/statuses, in 0.22 seconds)1833gitlab # [ 360.945100] gitlab-workhorse[891]: gitlab 2001:db8:1::1 - - [2026/09/03:10:19:03 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/355840ba9dedee876dcb3d79810f29ba69997a3c/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1571834gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/355840ba9dedee876dcb3d79810f29ba69997a3c/statuses1835gitlab # [ 362.108871] gitaly[961]: time="2026-09-03T10:19:04.978Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCEZ98TZM5PPSFJA45C30R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:19:34.276" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:19:04.976" grpc.time_ms=1.19 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1836gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/355840ba9dedee876dcb3d79810f29ba69997a3c/statuses, in 0.22 seconds)1837gitlab # [ 362.161857] gitlab-workhorse[891]: gitlab 2001:db8:1::1 - - [2026/09/03:10:19:05 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/355840ba9dedee876dcb3d79810f29ba69997a3c/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 1581838gitlab # [ 362.914471] nix-daemon[3929]: accepted connection from pid 3924, user nixbot1839gitlab # [ 363.106131] gitaly[961]: time="2026-09-03T10:19:05.976Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCF0882YKMWZXT2W9N4EMC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:19:35.874" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:19:05.975" grpc.time_ms=1.229 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1840gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/355840ba9dedee876dcb3d79810f29ba69997a3c/statuses1841gitlab # [ 363.182816] gitaly[961]: time="2026-09-03T10:19:06.052Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M1KCF0882YKMWZXT2W9N4EMC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-03T10:19:16.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:19:06.033" grpc.time_ms=19.199 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1842gitlab # [ 363.279208] gitlab-workhorse[891]: gitlab 2001:db8:1::1 - - [2026/09/03:10:19:06 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/355840ba9dedee876dcb3d79810f29ba69997a3c HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 2831843gitlab # [ 363.284644] nixbot[3692]: {"ts": "2026-09-03T10:19:06.151Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/355840ba9dedee876dcb3d79810f29ba69997a3c \"HTTP/1.1 201 Created\""}1844gitlab # [ 363.337124] gitaly[961]: time="2026-09-03T10:19:06.207Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCF0G8ATDKBPGB9ZYPW24R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:19:36.106" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:19:06.207" grpc.time_ms=0.764 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1845gitlab # [ 363.368247] gitlab-workhorse[891]: gitlab 2001:db8:1::1 - - [2026/09/03:10:19:06 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/355840ba9dedee876dcb3d79810f29ba69997a3c/statuses HTTP/1.1" 200 677 "" "curl/8.21.0" 1181846gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/355840ba9dedee876dcb3d79810f29ba69997a3c/statuses, in 0.21 seconds)1847gitlab # [ 363.377994] gitaly[961]: time="2026-09-03T10:19:06.248Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCF0HGRZP9R47Y7DM5F1WZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:19:36.146" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:19:06.247" grpc.time_ms=1 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1848gitlab # [ 363.453909] gitaly[961]: time="2026-09-03T10:19:06.324Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01M1KCF0HGRZP9R47Y7DM5F1WZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-03T10:19:16.278" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:19:06.309" grpc.time_ms=15.106 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1849gitlab # [ 363.526715] gitlab-workhorse[891]: gitlab 2001:db8:1::1 - - [2026/09/03:10:19:06 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/355840ba9dedee876dcb3d79810f29ba69997a3c HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2361850gitlab # [ 363.530807] nixbot[3692]: {"ts": "2026-09-03T10:19:06.399Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/355840ba9dedee876dcb3d79810f29ba69997a3c \"HTTP/1.1 201 Created\""}1851gitlab # [ 363.626584] gitaly[961]: time="2026-09-03T10:19:06.497Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCF0SMZSMPYF5ZEKZF0JNY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:19:36.395" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:19:06.496" grpc.time_ms=0.724 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1852gitlab # [ 363.698517] gitaly[961]: time="2026-09-03T10:19:06.569Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1KCF0SMZSMPYF5ZEKZF0JNY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-03T10:19:16.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:19:06.551" grpc.time_ms=17.87 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1853gitlab # [ 363.800984] gitlab-workhorse[891]: gitlab 2001:db8:1::1 - - [2026/09/03:10:19:06 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/355840ba9dedee876dcb3d79810f29ba69997a3c HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2501854gitlab # [ 363.809110] nixbot[3692]: {"ts": "2026-09-03T10:19:06.673Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/355840ba9dedee876dcb3d79810f29ba69997a3c \"HTTP/1.1 201 Created\""}1855gitlab # [ 364.148697] gitaly[961]: time="2026-09-03T10:19:07.019Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M1KCF18NFPS6N87M7P0BG5EA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:19:07.002" grpc.time_ms=16.92 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc1856gitlab # [ 364.177350] gitlab-workhorse[891]: gitlab 2001:db8:1::1 - - [2026/09/03:10:19:07 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1181857gitlab # [ 364.282843] gitaly[961]: time="2026-09-03T10:19:07.152Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1KCF1CEA8R1QQ2DN638P0K6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:19:07.132" pid=961 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1858gitlab # [ 364.315388] gitaly[961]: time="2026-09-03T10:19:07.152Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCF1CEA8R1QQ2DN638P0K6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:19:07.132" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc1859gitlab # [ 364.348757] gitlab-workhorse[891]: time="2026-09-03T10:19:07Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671860gitlab # [ 364.351853] gitlab-workhorse[891]: gitlab 2001:db8:1::1 - - [2026/09/03:10:19:07 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1301861gitlab # [ 364.355106] gitaly[961]: time="2026-09-03T10:19:07.153Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCF1CEA8R1QQ2DN638P0K6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:19:07.132" grpc.time_ms=20.704 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc1862gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/355840ba9dedee876dcb3d79810f29ba69997a3c/statuses1863gitlab # [ 364.502788] gitaly[961]: time="2026-09-03T10:19:07.373Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KCF1MVPCFW0G437BYCPRN0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:19:37.271" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:19:07.372" grpc.time_ms=0.99 pid=961 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1864gitlab # [ 364.553797] gitlab-workhorse[891]: gitlab 2001:db8:1::1 - - [2026/09/03:10:19:07 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/355840ba9dedee876dcb3d79810f29ba69997a3c/statuses HTTP/1.1" 200 1334 "" "curl/8.21.0" 1321865gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/355840ba9dedee876dcb3d79810f29ba69997a3c/statuses, in 0.18 seconds)1866(finished: subtest: eval and build post commit statuses, in 12.72 seconds)1867(finished: run the VM test script, in 438.13 seconds)1868test script finished in 438.18s1869cleanup1870kill QemuMachine (pid 46)1871gitlab # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/41m77i1296n33p6liin8ynr6wh3h6b7m-python3-3.14.6/bin/python3.14)1872(finished: cleanup, in 1.82 seconds)1873additionally exposed symbols:1874 gitlab,1875 vlan1,1876 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh1877[]1878[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-09-03T10:18:50.398Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]1879[]1880[]1881[{'id': 1, 'project_id': 1, 'number': 1, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '355840ba9dedee876dcb3d79810f29ba69997a3c', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'pending', 'eval_warnings': None, 'error': None, 'created_at': '2026-09-03T10:18:54.591573Z', 'started_at': None, 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': {'position': 1, 'blocked_by': []}}]1882[]1883[{'id': 1, 'sha': '355840ba9dedee876dcb3d79810f29ba69997a3c', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'waiting for evaluation', 'created_at': '2026-09-03T10:18:55.811Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]1884[{'id': 1, 'sha': '355840ba9dedee876dcb3d79810f29ba69997a3c', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'waiting for evaluation', 'created_at': '2026-09-03T10:18:55.811Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]1885[{'id': 1, 'sha': '355840ba9dedee876dcb3d79810f29ba69997a3c', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'waiting for evaluation', 'created_at': '2026-09-03T10:18:55.811Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]1886[{'id': 1, 'sha': '355840ba9dedee876dcb3d79810f29ba69997a3c', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'waiting for evaluation', 'created_at': '2026-09-03T10:18:55.811Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]1887[{'id': 1, 'sha': '355840ba9dedee876dcb3d79810f29ba69997a3c', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'waiting for evaluation', 'created_at': '2026-09-03T10:18:55.811Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]1888[{'id': 1, 'sha': '355840ba9dedee876dcb3d79810f29ba69997a3c', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'waiting for evaluation', 'created_at': '2026-09-03T10:18:55.811Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]1889[{'id': 1, 'sha': '355840ba9dedee876dcb3d79810f29ba69997a3c', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'waiting for evaluation', 'created_at': '2026-09-03T10:18:55.811Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]1890[{'id': 1, 'sha': '355840ba9dedee876dcb3d79810f29ba69997a3c', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'waiting for evaluation', 'created_at': '2026-09-03T10:18:55.811Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]1891[{'id': 1, 'sha': '355840ba9dedee876dcb3d79810f29ba69997a3c', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'evaluation succeeded in 9s (1 warning)', 'created_at': '2026-09-03T10:18:55.811Z', 'started_at': None, 'finished_at': '2026-09-03T10:19:06.099Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]1892[{'id': 1, 'sha': '355840ba9dedee876dcb3d79810f29ba69997a3c', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'evaluation succeeded in 9s (1 warning)', 'created_at': '2026-09-03T10:18:55.811Z', 'started_at': None, 'finished_at': '2026-09-03T10:19:06.099Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 2, 'sha': '355840ba9dedee876dcb3d79810f29ba69997a3c', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': '0 attributes built', 'created_at': '2026-09-03T10:19:06.360Z', 'started_at': None, 'finished_at': '2026-09-03T10:19:06.616Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]