vm-test-run-nixbot-gitlab
default.checks.aarch64-linux.nixbot-gitlab
· build #216
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab: QEMU running (pid 46)10gitlab # Disk image does not exist, creating the virtualisation disk image...11gitlab # Formatting '/build/vm-state-gitlab/tmp.99lGZms2O7', fmt=raw size=107374182412(finished: start all VMs, in 67.23 seconds)13gitlab # mke2fs 1.47.4 (6-Mar-2025)14gitlab: waiting for unit setup-gitlab.service15gitlab # Discarding device blocks: 0/262144 done16gitlab: waiting for the VM to finish booting17gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes18gitlab # Filesystem UUID: 424ce0df-75e7-485a-aa01-cf5f0d6e224b19gitlab # Superblock backups stored on blocks:20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]31gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Thu Aug 6 17:27:09 UTC 202632gitlab # [ 0.000000] KASLR enabled33gitlab # [ 0.000000] random: crng init done34gitlab # [ 0.000000] Machine model: linux,dummy-virt35gitlab # [ 0.000000] efi: UEFI not found.36gitlab # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT37gitlab # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff]38gitlab # [ 0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf]39gitlab # [ 0.000000] Zone ranges:40gitlab # [ 0.000000] DMA [mem 0x0000000040000000-0x00000000ffffffff]41gitlab # [ 0.000000] DMA32 empty42gitlab # [ 0.000000] Normal [mem 0x0000000100000000-0x00000001bfffffff]43gitlab # [ 0.000000] Device empty44gitlab # [ 0.000000] Movable zone start for each node45gitlab # [ 0.000000] Early memory node ranges46gitlab # [ 0.000000] node 0: [mem 0x0000000040000000-0x00000001bfffffff]47gitlab # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff]48gitlab # [ 0.000000] cma: Reserved 32 MiB at 0x00000000fe00000049gitlab # [ 0.000000] psci: probing for conduit method from DT.50gitlab # [ 0.000000] psci: PSCIv1.3 detected in firmware.51gitlab # [ 0.000000] psci: Using standard PSCI v0.2 function IDs52gitlab # [ 0.000000] psci: Trusted OS migration not required53gitlab # [ 0.000000] psci: SMC Calling Convention v1.154gitlab # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)55gitlab # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u31129656gitlab # [ 0.000000] Detected PIPT I-cache on CPU057gitlab # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)58gitlab # [ 0.000000] CPU features: detected: GICv3 CPU interface59gitlab # [ 0.000000] CPU features: detected: Spectre-v460gitlab # [ 0.000000] CPU features: detected: Spectre-BHB61gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_3862gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_2363gitlab # [ 0.000000] alternatives: applying boot alternatives64gitlab # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/3r8sjw40l9d8kk45i1s8rj9ggyy3p68h-nixos-system-gitlab-test/init regInfo=/nix/store/4dxgx29ba3avcsviva5afdkcqwnq0q67-closure-info/registration console=ttyAMA0,115200n8 console=tty065gitlab # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/4dxgx29ba3avcsviva5afdkcqwnq0q67-closure-info/registration", will be passed to user space.66gitlab # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes67gitlab # [ 0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)68gitlab # [ 0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)69gitlab # [ 0.000000] software IO TLB: area num 4.70gitlab # [ 0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB)71gitlab # [ 0.000000] Fallback order for Node 0: 072gitlab # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 157286473gitlab # [ 0.000000] Policy zone: Normal74gitlab # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off75gitlab # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=176gitlab # [ 0.000000] allocated 12582912 bytes of page_ext77gitlab # [ 0.000000] ftrace: allocating 74867 entries in 294 pages78gitlab # [ 0.000000] ftrace: allocated 294 pages with 4 groups79gitlab # [ 0.000000] rcu: Hierarchical RCU implementation.80gitlab # [ 0.000000] rcu: RCU event tracing is enabled.81gitlab # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.82gitlab # [ 0.000000] Trampoline variant of Tasks RCU enabled.83gitlab # [ 0.000000] Rude variant of Tasks RCU enabled.84gitlab # [ 0.000000] Tracing variant of Tasks RCU enabled.85gitlab # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.86gitlab # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=487gitlab # [ 0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.88gitlab # [ 0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.89gitlab # [ 0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.90gitlab # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 091gitlab # [ 0.000000] GICv3: 256 SPIs implemented92gitlab # [ 0.000000] GICv3: 0 Extended SPIs implemented93gitlab # [ 0.000000] Root IRQ handler: gic_handle_irq94gitlab # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI95gitlab # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=096gitlab # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a000097gitlab # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]98gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f00000 (indirect, esz 8, psz 64K, shr 1)99gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f10000 (flat, esz 8, psz 64K, shr 1)100gitlab # [ 0.000000] GICv3: using LPI property table @0x0000000100f20000101gitlab # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f30000102gitlab # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.103gitlab # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns104gitlab # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).105gitlab # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns106gitlab # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns107gitlab # [ 0.000028] arm-pv: using stolen time PV108gitlab # [ 0.000381] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)109gitlab # [ 0.000581] Console: colour dummy device 80x25110gitlab # [ 0.000588] printk: legacy console [tty0] enabled111gitlab # [ 0.000773] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)112gitlab # [ 0.000780] pid_max: default: 32768 minimum: 301113gitlab # [ 0.000865] LSM: initializing lsm=capability,landlock,yama,bpf,ima114gitlab # [ 0.001002] landlock: Up and running.115gitlab # [ 0.001005] Yama: becoming mindful.116gitlab # [ 0.001440] LSM support for eBPF active117gitlab # [ 0.001648] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)118gitlab # [ 0.001750] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)119gitlab # [ 0.002859] cacheinfo: Unable to detect cache hierarchy for CPU 0120gitlab # [ 0.003507] rcu: Hierarchical SRCU implementation.121gitlab # [ 0.003511] rcu: Max phase no-delay instances is 1000.122gitlab # [ 0.003655] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level123gitlab # [ 0.004663] fsl-mc MSI: its@8080000 domain created124gitlab # [ 0.004754] EFI services will not be available.125gitlab # [ 0.004922] smp: Bringing up secondary CPUs ...126gitlab # [ 0.005539] Detected PIPT I-cache on CPU1127gitlab # [ 0.005636] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000128gitlab # [ 0.005757] GICv3: CPU1: using allocated LPI pending table @0x0000000100f40000129gitlab # [ 0.005878] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40]130gitlab # [ 0.006915] Detected PIPT I-cache on CPU2131gitlab # [ 0.007018] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000132gitlab # [ 0.007139] GICv3: CPU2: using allocated LPI pending table @0x0000000100f50000133gitlab # [ 0.007261] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40]134gitlab # [ 0.008260] Detected PIPT I-cache on CPU3135gitlab # [ 0.008372] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000136gitlab # [ 0.008493] GICv3: CPU3: using allocated LPI pending table @0x0000000100f60000137gitlab # [ 0.008617] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40]138gitlab # [ 0.009199] smp: Brought up 1 node, 4 CPUs139gitlab # [ 0.009226] SMP: Total of 4 processors activated.140gitlab # [ 0.009229] CPU: All CPU(s) started at EL1141gitlab # [ 0.009237] CPU features: detected: Branch Target Identification142gitlab # [ 0.009241] CPU features: detected: ARMv8.4 Translation Table Level143gitlab # [ 0.009244] CPU features: detected: Instruction cache invalidation not required for I/D coherence144gitlab # [ 0.009247] CPU features: detected: Data cache clean to the PoU not required for I/D coherence145gitlab # [ 0.009250] CPU features: detected: Common not Private translations146gitlab # [ 0.009253] CPU features: detected: CRC32 instructions147gitlab # [ 0.009255] CPU features: detected: Data cache clean to Point of Deep Persistence148gitlab # [ 0.009259] CPU features: detected: Data cache clean to Point of Persistence149gitlab # [ 0.009262] CPU features: detected: Data independent timing control (DIT)150gitlab # [ 0.009264] CPU features: detected: E0PD151gitlab # [ 0.009266] CPU features: detected: Enhanced Counter Virtualization152gitlab # [ 0.009269] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)153gitlab # [ 0.009272] CPU features: detected: Enhanced Virtualization Traps154gitlab # [ 0.009275] CPU features: detected: Fine Grained Traps155gitlab # [ 0.009277] CPU features: detected: Generic authentication (architected QARMA5 algorithm)156gitlab # [ 0.009281] CPU features: detected: RCpc load-acquire (LDAPR)157gitlab # [ 0.009284] CPU features: detected: LSE atomic instructions158gitlab # [ 0.009286] CPU features: detected: Privileged Access Never159gitlab # [ 0.009288] CPU features: detected: PMUv3160gitlab # [ 0.009291] CPU features: detected: RAS Extension Support161gitlab # [ 0.009293] CPU features: detected: RASv1p1 Extension Support162gitlab # [ 0.009295] CPU features: detected: Random Number Generator163gitlab # [ 0.009298] CPU features: detected: Speculation barrier (SB)164gitlab # [ 0.009300] CPU features: detected: Stage-2 Force Write-Back165gitlab # [ 0.009303] CPU features: detected: TLB range maintenance instructions166gitlab # [ 0.009306] CPU features: detected: Speculative Store Bypassing Safe (SSBS)167gitlab # [ 0.009441] alternatives: applying system-wide alternatives168gitlab # [ 0.012198] CPU features: detected: BBM Level 2 without TLB conflict abort169gitlab # [ 0.012455] Memory: 5963840K/6291456K available (24448K kernel code, 7090K rwdata, 26340K rodata, 4736K init, 1106K bss, 272908K reserved, 32768K cma-reserved)170gitlab # [ 0.013833] devtmpfs: initialized171gitlab # [ 0.017608] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)172gitlab # [ 0.017675] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).173gitlab # [ 0.017860] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL174gitlab # [ 0.017864] 0 pages in range for non-PLT usage175gitlab # [ 0.017865] 508288 pages in range for PLT usage176gitlab # [ 0.017979] pinctrl core: initialized pinctrl subsystem177gitlab # [ 0.018788] DMI not present or invalid.178gitlab # [ 0.022137] NET: Registered PF_NETLINK/PF_ROUTE protocol family179gitlab # [ 0.024419] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations180gitlab # [ 0.024688] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations181gitlab # [ 0.026481] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations182gitlab # [ 0.026504] audit: initializing netlink subsys (disabled)183gitlab # [ 0.026814] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1184gitlab # [ 0.027299] thermal_sys: Registered thermal governor 'fair_share'185gitlab # [ 0.027302] thermal_sys: Registered thermal governor 'bang_bang'186gitlab # [ 0.027306] thermal_sys: Registered thermal governor 'step_wise'187gitlab # [ 0.027309] thermal_sys: Registered thermal governor 'user_space'188gitlab # [ 0.027311] thermal_sys: Registered thermal governor 'power_allocator'189gitlab # [ 0.027400] cpuidle: using governor ladder190gitlab # [ 0.027423] cpuidle: using governor menu191gitlab # [ 0.027620] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.192gitlab # [ 0.027831] ASID allocator initialised with 65536 entries193gitlab # [ 0.028971] Serial: AMBA PL011 UART driver194gitlab # [ 0.034050] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1195gitlab # [ 0.034353] printk: console [ttyAMA0] enabled196gitlab # [ 0.043817] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages197gitlab # [ 0.043824] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page198gitlab # [ 0.043827] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages199gitlab # [ 0.043830] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page200gitlab # [ 0.043832] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages201gitlab # [ 0.043835] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page202gitlab # [ 0.043838] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages203gitlab # [ 0.043841] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page204gitlab # [ 0.056638] fbcon: Taking over console205gitlab # [ 0.056668] ACPI: Interpreter disabled.206gitlab # [ 0.059267] iommu: Default domain type: Translated207gitlab # [ 0.059279] iommu: DMA domain TLB invalidation policy: strict mode208gitlab # [ 0.067895] SCSI subsystem initialized209gitlab # [ 0.068305] usbcore: registered new interface driver usbfs210gitlab # [ 0.068332] usbcore: registered new interface driver hub211gitlab # [ 0.068351] usbcore: registered new device driver usb212gitlab # [ 0.068675] pps_core: LinuxPPS API ver. 1 registered213gitlab # [ 0.068679] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>214gitlab # [ 0.068688] PTP clock support registered215gitlab # [ 0.068729] EDAC MC: Ver: 3.0.0216gitlab # [ 0.069195] scmi_core: SCMI protocol bus registered217gitlab # [ 0.070096] FPGA manager framework218gitlab # [ 0.070930] vgaarb: loaded219gitlab # [ 0.072981] clocksource: Switched to clocksource arch_sys_counter220gitlab # [ 0.089188] VFS: Disk quotas dquot_6.6.0221gitlab # [ 0.089252] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)222gitlab # [ 0.089984] netfs: FS-Cache loaded223gitlab # [ 0.090223] pnp: PnP ACPI: disabled224gitlab # [ 0.098076] NET: Registered PF_INET protocol family225gitlab # [ 0.099169] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)226gitlab # [ 0.133442] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)227gitlab # [ 0.133494] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)228gitlab # [ 0.133538] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)229gitlab # [ 0.133825] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)230gitlab # [ 0.134426] TCP: Hash tables configured (established 65536 bind 65536)231gitlab # [ 0.134526] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)232gitlab # [ 0.134578] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)233gitlab # [ 0.134697] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)234gitlab # [ 0.134899] NET: Registered PF_UNIX/PF_LOCAL protocol family235gitlab # [ 0.134916] NET: Registered PF_XDP protocol family236gitlab # [ 0.134931] PCI: CLS 0 bytes, default 64237gitlab # [ 0.135289] Trying to unpack rootfs image as initramfs...238gitlab # [ 0.146225] kvm [1]: HYP mode not available239gitlab # [ 0.193625] Initialise system trusted keyrings240gitlab # [ 0.193865] workingset: timestamp_bits=42 max_order=21 bucket_order=0241gitlab # [ 0.197282] squashfs: version 4.0 (2009/01/31) Phillip Lougher242gitlab # [ 0.201044] 9p: Installing v9fs 9p2000 file system support243gitlab # [ 0.213088] Key type asymmetric registered244gitlab # [ 0.213093] Asymmetric key parser 'x509' registered245gitlab # [ 0.213135] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)246gitlab # [ 0.213362] io scheduler mq-deadline registered247gitlab # [ 0.213368] io scheduler kyber registered248gitlab # [ 0.221568] pl061_gpio 9030000.pl061: PL061 GPIO chip registered249gitlab # [ 0.226083] ledtrig-cpu: registered to indicate activity on CPUs250gitlab # [ 0.226418] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:251gitlab # [ 0.226438] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000252gitlab # [ 0.226447] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000253gitlab # [ 0.226453] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000254gitlab # [ 0.226475] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits255gitlab # [ 0.226493] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]256gitlab # [ 0.226554] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00257gitlab # [ 0.226561] pci_bus 0000:00: root bus resource [bus 00-ff]258gitlab # [ 0.226565] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]259gitlab # [ 0.226568] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]260gitlab # [ 0.226571] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]261gitlab # [ 0.226629] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint262gitlab # [ 0.227125] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint263gitlab # [ 0.227341] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]264gitlab # [ 0.227354] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]265gitlab # [ 0.227386] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]266gitlab # [ 0.227399] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]267gitlab # [ 0.227934] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint268gitlab # [ 0.228149] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]269gitlab # [ 0.228161] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]270gitlab # [ 0.228192] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]271gitlab # [ 0.228727] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint272gitlab # [ 0.228937] pci 0000:00:03.0: BAR 0 [io 0x0000-0x001f]273gitlab # [ 0.228949] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]274gitlab # [ 0.229004] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]275gitlab # [ 0.229562] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint276gitlab # [ 0.229781] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]277gitlab # [ 0.229793] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]278gitlab # [ 0.229825] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]279gitlab # [ 0.230341] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint280gitlab # [ 0.230541] pci 0000:00:05.0: BAR 0 [io 0x0000-0x007f]281gitlab # [ 0.230552] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]282gitlab # [ 0.230579] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]283gitlab # [ 0.231069] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint284gitlab # [ 0.231274] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]285gitlab # [ 0.231285] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]286gitlab # [ 0.231312] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]287gitlab # [ 0.231826] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint288gitlab # [ 0.232020] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]289gitlab # [ 0.232033] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]290gitlab # [ 0.232063] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]291gitlab # [ 0.232079] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]292gitlab # [ 0.232608] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint293gitlab # [ 0.232812] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]294gitlab # [ 0.232839] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]295gitlab # [ 0.233384] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint296gitlab # [ 0.233604] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]297gitlab # [ 0.233635] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]298gitlab # [ 0.234073] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint299gitlab # [ 0.234271] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]300gitlab # [ 0.234518] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint301gitlab # [ 0.234767] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]302gitlab # [ 0.234779] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]303gitlab # [ 0.234805] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]304gitlab # [ 0.235310] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint305gitlab # [ 0.235507] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]306gitlab # [ 0.235519] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]307gitlab # [ 0.235548] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]308gitlab # [ 0.236165] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned309gitlab # [ 0.236172] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned310gitlab # [ 0.236176] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned311gitlab # [ 0.236218] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned312gitlab # [ 0.236262] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned313gitlab # [ 0.236305] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned314gitlab # [ 0.236350] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned315gitlab # [ 0.236396] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned316gitlab # [ 0.236440] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned317gitlab # [ 0.236484] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned318gitlab # [ 0.236532] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned319gitlab # [ 0.236576] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned320gitlab # [ 0.236634] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned321gitlab # [ 0.236678] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned322gitlab # [ 0.236696] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned323gitlab # [ 0.236713] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned324gitlab # [ 0.236731] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned325gitlab # [ 0.236749] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned326gitlab # [ 0.236767] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned327gitlab # [ 0.236785] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned328gitlab # [ 0.236802] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned329gitlab # [ 0.236821] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned330gitlab # [ 0.236839] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned331gitlab # [ 0.236858] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned332gitlab # [ 0.236876] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned333gitlab # [ 0.236899] pci 0000:00:05.0: BAR 0 [io 0x1000-0x107f]: assigned334gitlab # [ 0.236917] pci 0000:00:06.0: BAR 0 [io 0x1080-0x10ff]: assigned335gitlab # [ 0.236934] pci 0000:00:0b.0: BAR 0 [io 0x1100-0x113f]: assigned336gitlab # [ 0.236951] pci 0000:00:01.0: BAR 0 [io 0x1140-0x115f]: assigned337gitlab # [ 0.236969] pci 0000:00:02.0: BAR 0 [io 0x1160-0x117f]: assigned338gitlab # [ 0.236999] pci 0000:00:03.0: BAR 0 [io 0x1180-0x119f]: assigned339gitlab # [ 0.237021] pci 0000:00:04.0: BAR 0 [io 0x11a0-0x11bf]: assigned340gitlab # [ 0.237039] pci 0000:00:07.0: BAR 0 [io 0x11c0-0x11df]: assigned341gitlab # [ 0.237061] pci 0000:00:0c.0: BAR 0 [io 0x11e0-0x11ff]: assigned342gitlab # [ 0.237083] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]343gitlab # [ 0.237088] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]344gitlab # [ 0.237091] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]345gitlab # [ 0.238444] pci 0000:00:0a.0: enabling device (0000 -> 0002)346gitlab # [ 0.250331] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)347gitlab # [ 0.252642] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)348gitlab # [ 0.254694] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)349gitlab # [ 0.256865] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)350gitlab # [ 0.258965] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)351gitlab # [ 0.262342] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)352gitlab # [ 0.266332] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)353gitlab # [ 0.268500] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)354gitlab # [ 0.270601] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)355gitlab # [ 0.272355] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)356gitlab # [ 0.274493] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)357gitlab # [ 0.284798] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled358gitlab # [ 0.286536] msm_serial: driver initialized359gitlab # [ 0.286663] SuperH (H)SCI(F) driver initialized360gitlab # [ 0.286713] STM32 USART driver initialized361gitlab # [ 0.305832] loop: module loaded362gitlab # [ 0.306033] virtio_blk virtio4: 4/0/0 default/read/poll queues363gitlab # [ 0.307777] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)364gitlab # [ 0.309560] virtio_blk virtio5: 4/0/0 default/read/poll queues365gitlab # [ 0.311313] virtio_blk virtio5: [vdb] 12227536 512-byte logical blocks (6.26 GB/5.83 GiB)366gitlab # [ 0.313349] megasas: 07.734.00.00-rc1367gitlab # [ 0.313997] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]368gitlab # [ 0.318799] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000369gitlab # [ 0.318848] Intel/Sharp Extended Query Table at 0x0031370gitlab # [ 0.320346] Using buffer write method371gitlab # [ 0.320375] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]372gitlab # [ 0.322114] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000373gitlab # [ 0.322128] Intel/Sharp Extended Query Table at 0x0031374gitlab # [ 0.323675] Using buffer write method375gitlab # [ 0.323688] Concatenating MTD devices:376gitlab # [ 0.323691] (0): "0.flash"377gitlab # [ 0.323693] (1): "0.flash"378gitlab # [ 0.323694] into device "0.flash"379gitlab # [ 0.625316] Freeing initrd memory: 27184K380gitlab # [ 0.641456] tun: Universal TUN/TAP device driver, 1.6381gitlab # [ 0.649132] thunder_xcv, ver 1.0382gitlab # [ 0.649224] thunder_bgx, ver 1.0383gitlab # [ 0.649283] nicpf, ver 1.0384gitlab # [ 0.650915] e1000: Intel(R) PRO/1000 Network Driver385gitlab # [ 0.650927] e1000: Copyright (c) 1999-2006 Intel Corporation.386gitlab # [ 0.651011] e1000e: Intel(R) PRO/1000 Network Driver387gitlab # [ 0.651024] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.388gitlab # [ 0.651091] igb: Intel(R) Gigabit Ethernet Network Driver389gitlab # [ 0.651099] igb: Copyright (c) 2007-2014 Intel Corporation.390gitlab # [ 0.651157] igbvf: Intel(R) Gigabit Virtual Function Network Driver391gitlab # [ 0.651166] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.392gitlab # [ 0.651553] sky2: driver version 1.30393gitlab # [ 0.656337] usbcore: registered new interface driver usb-storage394gitlab # [ 0.656753] usbcore: registered new interface driver usbserial_generic395gitlab # [ 0.656801] usbserial: USB Serial support registered for generic396gitlab # [ 0.656822] ehci-pci 0000:00:0a.0: EHCI Host Controller397gitlab # [ 0.656897] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1398gitlab # [ 0.657617] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000399gitlab # [ 0.658731] hv_vmbus: registering driver hyperv_keyboard400gitlab # [ 0.661262] rtc-pl031 9010000.pl031: registered as rtc0401gitlab # [ 0.661317] rtc-pl031 9010000.pl031: setting system clock to 2026-08-15T09:29:04 UTC (1786786144)402gitlab # [ 0.662163] i2c_dev: i2c /dev entries driver403gitlab # [ 0.669130] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00404gitlab # [ 0.670372] hub 1-0:1.0: USB hub found405gitlab # [ 0.670393] sdhci: Secure Digital Host Controller Interface driver406gitlab # [ 0.670412] sdhci: Copyright(c) Pierre Ossman407gitlab # [ 0.670426] hub 1-0:1.0: 6 ports detected408gitlab # [ 0.671237] Synopsys Designware Multimedia Card Interface Driver409gitlab # [ 0.672365] sdhci-pltfm: SDHCI platform and OF driver helper410gitlab # [ 0.677055] hid: raw HID events driver (C) Jiri Kosina411gitlab # [ 0.677980] usbcore: registered new interface driver usbhid412gitlab # [ 0.677992] usbhid: USB HID core driver413gitlab # [ 0.710712] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available414gitlab # [ 0.715265] drop_monitor: Initializing network drop monitor service415gitlab # [ 0.715676] NET: Registered PF_INET6 protocol family416gitlab # [ 0.717501] Segment Routing with IPv6417gitlab # [ 0.717538] In-situ OAM (IOAM) with IPv6418gitlab # [ 0.717602] NET: Registered PF_PACKET protocol family419gitlab # [ 0.717924] 9pnet: Installing 9P2000 support420gitlab # [ 0.721835] Key type dns_resolver registered421gitlab # [ 0.739231] registered taskstats version 1422gitlab # [ 0.739742] Loading compiled-in X.509 certificates423gitlab # [ 0.761633] Demotion targets for Node 0: null424gitlab # [ 0.761887] Key type .fscrypt registered425gitlab # [ 0.761895] Key type fscrypt-provisioning registered426gitlab # [ 0.762056] ima: No TPM chip found, activating TPM-bypass!427gitlab # [ 0.762079] ima: Allocated hash algorithm: sha1428gitlab # [ 0.762109] ima: No architecture policies found429gitlab # [ 0.763253] input: gpio-keys as /devices/platform/gpio-keys/input/input0430gitlab # [ 0.801369] clk: Disabling unused clocks431gitlab # [ 0.801412] PM: genpd: Disabling unused power domains432gitlab # [ 0.809979] Freeing unused kernel memory: 4736K433gitlab # [ 0.810333] Run /init as init process434gitlab # [ 0.851693] systemd[1]: Successfully made /usr/ read-only.435gitlab # [ 0.921061] usb 1-1: new high-speed USB device number 2 using ehci-pci436gitlab # [ 1.079878] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1437gitlab # [ 1.165527] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0438gitlab # [ 1.186358] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)439gitlab # [ 1.186425] systemd[1]: Detected virtualization qemu.440gitlab # [ 1.186493] systemd[1]: Detected architecture arm64.441gitlab # [ 1.186509] systemd[1]: Running in initrd.442gitlab # [ 1.187308] systemd[1]: Initializing machine ID from random generator.443gitlab # [ 1.187652] systemd[1]: Hostname set to <gitlab>.444gitlab # [ 1.285069] usb 1-2: new high-speed USB device number 3 using ehci-pci445gitlab # [ 1.435781] systemd[1]: bpf-restrict-fs: LSM BPF program attached446gitlab # [ 1.437446] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2447gitlab # [ 1.437736] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0448gitlab # [ 1.520543] systemd[1]: Queued start job for default target Initrd Default Target.449gitlab # [ 1.540251] systemd[1]: Created slice Slice /system/modprobe.450gitlab # [ 1.540558] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.451gitlab # [ 1.540602] systemd[1]: Expecting device /dev/disk/by-label/nix-store...452gitlab # [ 1.540621] systemd[1]: Expecting device /dev/disk/by-label/nixos...453gitlab # [ 1.540651] systemd[1]: Reached target Path Units.454gitlab # [ 1.540673] systemd[1]: Reached target Slice Units.455gitlab # [ 1.540697] systemd[1]: Reached target Swaps.456gitlab # [ 1.540717] systemd[1]: Reached target Timer Units.457gitlab # [ 1.540920] systemd[1]: Listening on D-Bus System Message Bus Socket.458gitlab # [ 1.541226] systemd[1]: Listening on Journal Socket (/dev/log).459gitlab # [ 1.541426] systemd[1]: Listening on Journal Sockets.460gitlab # [ 1.541612] systemd[1]: Listening on udev Control Socket.461gitlab # [ 1.541724] systemd[1]: Listening on udev Kernel Socket.462gitlab # [ 1.541751] systemd[1]: Reached target Socket Units.463gitlab # [ 1.544003] systemd[1]: Starting Create List of Static Device Nodes...464gitlab # [ 1.546266] systemd[1]: Starting Load Kernel Module 9pnet_virtio...465gitlab # [ 1.546358] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs466gitlab # [ 1.548627] systemd[1]: Mounting Kernel Configuration File System...467gitlab # [ 1.575154] systemd[1]: Starting Journal Service...468gitlab # [ 1.582459] systemd[1]: Starting Load Kernel Modules...469gitlab # [ 1.582576] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os470gitlab # [ 1.584266] systemd[1]: Starting Coldplug All udev Devices...471gitlab # [ 1.590657] systemd[1]: Finished Create List of Static Device Nodes.472gitlab # [ 1.591783] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.473gitlab # [ 1.592198] systemd[1]: Finished Load Kernel Module 9pnet_virtio.474gitlab # [ 1.592527] systemd[1]: Mounted Kernel Configuration File System.475gitlab # [ 1.594883] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...476gitlab # [ 1.623238] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0477gitlab # [ 1.623483] [drm] features: -virgl +edid -resource_blob -host_visible478gitlab # [ 1.623488] [drm] features: -context_init479gitlab # [ 1.624637] [drm] number of scanouts: 1480gitlab # [ 1.624654] [drm] number of cap sets: 0481gitlab # [ 1.629509] systemd-journald[94]: Collecting audit messages is disabled.482gitlab # [ 1.630815] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic483gitlab # [ 1.630829] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0484gitlab # [ 1.646135] Console: switching to colour frame buffer device 160x50485gitlab # [ 1.646405] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.486gitlab # [ 1.646587] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev487gitlab # [ 1.647556] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device488gitlab # [ 1.647818] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.489gitlab # [ 1.660287] systemd[1]: Starting Create Static Device Nodes in /dev...490gitlab # [ 1.681515] systemd[1]: Finished Load Kernel Modules.491gitlab # [ 1.685223] systemd[1]: Starting Apply Kernel Variables...492gitlab # [ 1.700302] systemd[1]: Finished Create Static Device Nodes in /dev.493gitlab # [ 1.700812] systemd[1]: Reached target Preparation for Local File Systems.494gitlab # [ 1.701651] systemd[1]: Reached target Local File Systems.495gitlab # [ 1.708527] systemd[1]: Starting Rule-based Manager for Device Events and Files...496gitlab # [ 1.711587] systemd[1]: Started Journal Service.497gitlab # [ 1.710336] systemd-modules-load[95]: Using 4 probe threads498gitlab # [ 1.714373] systemd-modules-load[95]: Module 'virtio_balloon' is built in499gitlab # [ 1.715619] systemd-modules-load[95]: Module 'virtio_console' is built in500gitlab # [ 1.720469] systemd-modules-load[95]: Module 'virtio_rng' is built in501gitlab # [ 1.721618] systemd-modules-load[95]: Inserted module 'dm_mod'502gitlab # [ 1.722697] systemd-modules-load[95]: Inserted module 'virtio_gpu'503gitlab # [ 1.723748] systemd[1]: Starting Create System Files and Directories...504gitlab # [ 1.725038] systemd[1]: Finished Apply Kernel Variables.505gitlab # [ 1.766991] systemd[1]: Finished Create System Files and Directories.506gitlab # [ 1.789404] systemd-udevd[107]: Using default interface naming scheme 'v261'.507gitlab # [ 1.811618] systemd[1]: Started Rule-based Manager for Device Events and Files.508gitlab # [ 1.829744] systemd[1]: Starting Virtual Console Setup...509gitlab # [ 1.869949] systemd-vconsole-setup[132]: Configuration of first virtual console was skipped, ignoring remaining ones.510gitlab # [ 1.874324] systemd[1]: Finished Virtual Console Setup.511gitlab # [ 2.187118] systemd[1]: Finished Coldplug All udev Devices.512gitlab # [ 2.189803] systemd[1]: Reached target System Initialization.513gitlab # [ 2.192343] systemd[1]: Reached target Basic System.514gitlab # [ 2.360620] (udev-worker)[143]: Network interface NamePolicy= disabled on kernel command line.515gitlab # [ 2.368568] (udev-worker)[136]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.516gitlab # [ 2.375059] (udev-worker)[136]: Network interface NamePolicy= disabled on kernel command line.517gitlab # [ 2.391269] systemd[1]: Found device /dev/disk/by-label/nix-store.518gitlab # [ 2.407544] systemd[1]: Found device /dev/disk/by-label/nixos.519gitlab # [ 2.411870] systemd[1]: Reached target Initrd Root Device.520gitlab # [ 2.415676] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...521gitlab # [ 2.450133] systemd-fsck[154]: nixos: clean, 12/65536 files, 13019/262144 blocks522gitlab # [ 2.452959] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.523gitlab # [ 2.585493] systemd[1]: Mounting /sysroot...524gitlab # [ 2.620907] EXT4-fs (vda): mounted filesystem 424ce0df-75e7-485a-aa01-cf5f0d6e224b r/w with ordered data mode. Quota mode: none.525gitlab # [ 2.623879] systemd[1]: Mounted /sysroot.526gitlab # [ 2.625109] systemd[1]: Reached target Initrd Root File System.527gitlab # [ 2.626279] systemd[1]: Starting Mountpoints Configured in the Real Root...528gitlab # [ 2.651383] systemd-sysroot-fstab-check[162]: /sysroot should be mounted in the initrd, will request daemon-reload.529gitlab # [ 2.654223] systemd[1]: Reload requested from client PID 162 ('systemd-sysroot') (unit initrd-parse-etc.service)...530gitlab # [ 2.655792] systemd[1]: Reloading...531gitlab # [ 2.748896] systemd[1]: Reloading finished in 94 ms.532gitlab # [ 2.803080] systemd-sysroot-fstab-check[162]: Requesting initrd-fs.target/start/replace...533gitlab # [ 2.804354] systemd-sysroot-fstab-check[162]: Requesting swap.target/start/replace...534gitlab # [ 2.807417] systemd[1]: Starting Load Kernel Module 9pnet_virtio...535gitlab # [ 2.811050] systemd[1]: initrd-parse-etc.service: Deactivated successfully.536gitlab # [ 2.820779] systemd[1]: Finished Mountpoints Configured in the Real Root.537gitlab # [ 2.822600] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.538gitlab # [ 2.828913] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.539gitlab # [ 2.832162] systemd[1]: Finished Load Kernel Module 9pnet_virtio.540gitlab # [ 2.882286] (udev-worker)[136]: mtd0ro: Failed to find and pin callout binary "/nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/mtd_probe": No such file or directory541gitlab # [ 2.885656] (udev-worker)[136]: mtd0ro: /nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory542gitlab # [ 2.891535] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.543gitlab # [ 2.893116] systemd[1]: Stopped Virtual Console Setup.544gitlab # [ 2.894438] systemd[1]: Stopping Virtual Console Setup...545gitlab # [ 2.895244] systemd[1]: Starting Virtual Console Setup...546gitlab # [ 2.932839] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.547gitlab # [ 2.934127] systemd[1]: Stopped Virtual Console Setup.548gitlab # [ 2.935001] systemd[1]: Starting Virtual Console Setup...549gitlab # [ 2.952711] systemd-vconsole-setup[185]: Configuration of first virtual console was skipped, ignoring remaining ones.550gitlab # [ 2.954616] systemd[1]: Finished Virtual Console Setup.551gitlab # [ 3.591324] systemd[1]: Mounting /sysroot/nix/.ro-store...552gitlab # [ 3.594635] systemd[1]: Mounting /sysroot/nix/.rw-store...553gitlab # [ 3.600214] systemd[1]: Mounting /sysroot/run...554gitlab # [ 3.617459] systemd[1]: Mounting /sysroot/tmp/shared...555gitlab # [ 3.624216] systemd[1]: Mounting /sysroot/tmp/xchg...556gitlab # [ 3.640587] systemd[1]: Mounted /sysroot/nix/.rw-store.557gitlab # [ 3.652175] systemd[1]: Starting rw-sysroot-nix-store.service...558gitlab # [ 3.657589] systemd[1]: Mounted /sysroot/run.559gitlab # [ 3.657770] erofs (device vdb): mounted with root inode @ nid 128.560gitlab # [ 3.664460] systemd[1]: Mounted /sysroot/nix/.ro-store.561gitlab # [ 3.666991] systemd[1]: Mounted /sysroot/tmp/shared.562gitlab # [ 3.668932] systemd[1]: Mounted /sysroot/tmp/xchg.563gitlab # [ 3.689021] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.564gitlab # [ 3.691414] systemd[1]: Finished rw-sysroot-nix-store.service.565gitlab # [ 4.589007] systemd[1]: Mounting /sysroot/nix/store...566gitlab # [ 4.662512] systemd[1]: Mounted /sysroot/nix/store.567gitlab # [ 4.664879] systemd[1]: Reached target Initrd File Systems.568gitlab # [ 4.667286] systemd[1]: Starting Find NixOS closure...569gitlab # [ 4.669898] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...570gitlab # [ 4.715530] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.571gitlab # [ 4.719316] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.572gitlab # [ 4.735475] systemd[1]: Finished Find NixOS closure.573gitlab # [ 4.738058] systemd[1]: Reached target Initrd Default Target.574gitlab # [ 4.740599] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...575gitlab # [ 4.791558] systemd[1]: Stopped target Initrd Default Target.576gitlab # [ 4.794223] systemd[1]: Stopped target Basic System.577gitlab # [ 4.796509] systemd[1]: Stopped target Initrd Root Device.578gitlab # [ 4.798883] systemd[1]: Stopped target Path Units.579gitlab # [ 4.801123] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.580gitlab # [ 4.804351] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.581gitlab # [ 4.807614] systemd[1]: Stopped target Slice Units.582gitlab # [ 4.809908] systemd[1]: Stopped target Socket Units.583gitlab # [ 4.812105] systemd[1]: Stopped target System Initialization.584gitlab # [ 4.817784] systemd[1]: Stopped target Swaps.585gitlab # [ 4.822141] systemd[1]: Stopped target Timer Units.586gitlab # [ 4.826638] systemd[1]: dbus.socket: Deactivated successfully.587gitlab # [ 4.832067] systemd[1]: Closed D-Bus System Message Bus Socket.588gitlab # [ 4.834703] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.589gitlab # [ 4.839129] systemd[1]: Stopped Find NixOS closure.590gitlab # [ 4.841076] systemd[1]: Starting Load Kernel Module 9pnet_virtio...591gitlab # [ 4.843098] systemd[1]: Starting rw-sysroot-nix-store.service...592gitlab # [ 4.845475] systemd[1]: systemd-sysctl.service: Deactivated successfully.593gitlab # [ 4.847566] systemd[1]: Stopped Apply Kernel Variables.594gitlab # [ 4.849346] systemd[1]: systemd-modules-load.service: Deactivated successfully.595gitlab # [ 4.851539] systemd[1]: Stopped Load Kernel Modules.596gitlab # [ 4.853378] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.597gitlab # [ 4.855757] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.598gitlab # [ 4.858274] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.599gitlab # [ 4.860542] systemd[1]: Stopped Create System Files and Directories.600gitlab # [ 4.862636] systemd[1]: Stopped target Local File Systems.601gitlab # [ 4.864505] systemd[1]: Stopped target Preparation for Local File Systems.602gitlab # [ 4.866597] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.603gitlab # [ 4.868859] systemd[1]: Stopped Coldplug All udev Devices.604gitlab # [ 4.870568] systemd[1]: Stopping Rule-based Manager for Device Events and Files...605gitlab # [ 4.872892] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.606gitlab # [ 4.875069] systemd[1]: Stopped Virtual Console Setup.607gitlab # [ 4.876704] systemd[1]: initrd-cleanup.service: Deactivated successfully.608gitlab # [ 4.878603] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.609gitlab # [ 4.880493] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.610gitlab # [ 4.882346] systemd[1]: Finished Load Kernel Module 9pnet_virtio.611gitlab # [ 4.883909] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.612gitlab # [ 4.885830] systemd[1]: Finished rw-sysroot-nix-store.service.613gitlab # [ 4.887280] systemd[1]: systemd-udevd.service: Deactivated successfully.614gitlab # [ 4.888970] systemd[1]: Stopped Rule-based Manager for Device Events and Files.615gitlab # [ 4.890665] systemd[1]: systemd-udevd.service: Consumed 2.028s CPU time over 3.157s wall clock time, 31.7M memory peak.616gitlab # [ 4.893324] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.617gitlab # [ 4.894954] systemd[1]: Closed udev Control Socket.618gitlab # [ 4.896138] systemd[1]: Starting Cleanup udev Database...619gitlab # [ 4.897327] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.620gitlab # [ 4.898948] systemd[1]: Stopped Create Static Device Nodes in /dev.621gitlab # [ 4.900321] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.622gitlab # [ 4.901985] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.623gitlab # [ 4.903452] systemd[1]: kmod-static-nodes.service: Deactivated successfully.624gitlab # [ 4.904945] systemd[1]: Stopped Create List of Static Device Nodes.625gitlab # [ 4.962441] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.626gitlab # [ 4.965715] systemd[1]: Finished Cleanup udev Database.627gitlab # [ 4.967894] systemd[1]: Reached target Switch Root.628gitlab # [ 4.970175] systemd[1]: Starting NixOS Activation...629gitlab # [ 5.122905] initrd-nixos-activation-start[223]: booting system configuration /nix/store/3r8sjw40l9d8kk45i1s8rj9ggyy3p68h-nixos-system-gitlab-test630gitlab # [ 5.185960] initrd-nixos-activation-start[223]: running activation script...631gitlab # [ 5.507058] initrd-nixos-activation-start[246]: setting up /etc...632gitlab # [ 5.677102] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.633gitlab # [ 5.680464] systemd[1]: Finished NixOS Activation.634gitlab # [ 5.682575] systemd[1]: Starting Switch Root...635gitlab # [ 5.734689] systemd[1]: Switching root.636gitlab # [ 5.889173] systemd-journald[94]: Received SIGTERM from PID 1 (systemd).637gitlab # [ 6.511377] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)638gitlab # [ 6.511518] systemd[1]: Detected virtualization qemu.639gitlab # [ 6.511623] systemd[1]: Detected architecture arm64.640gitlab # [ 6.511875] systemd[1]: Detected first boot.641gitlab # [ 6.514430] systemd[1]: Initializing machine ID from random generator.642gitlab # [ 6.811233] systemd[1]: bpf-restrict-fs: LSM BPF program attached643gitlab # [ 6.918192] systemd[1]: Applying preset policy.644gitlab # [ 7.107849] systemd[1]: Populated /etc with preset unit settings.645gitlab # [ 7.280220] systemd[1]: initrd-switch-root.service: Deactivated successfully.646gitlab # [ 7.281032] systemd[1]: Stopped initrd-switch-root.service.647gitlab # [ 7.283421] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.648gitlab # [ 7.287919] systemd[1]: Created slice Slice /system/getty.649gitlab # [ 7.294008] systemd[1]: Created slice GitLab DevOps Platform Slice.650gitlab # [ 7.297597] systemd[1]: Created slice User and Session Slice.651gitlab # [ 7.298196] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.652gitlab # [ 7.298933] systemd[1]: Started Forward Password Requests to Wall Directory Watch.653gitlab # [ 7.299662] systemd[1]: Expecting device /dev/hvc0...654gitlab # [ 7.300317] systemd[1]: Expecting device /dev/ttyAMA0...655gitlab # [ 7.301098] systemd[1]: Reached target Local Encrypted Volumes.656gitlab # [ 7.301835] systemd[1]: Stopped target initrd-fs.target.657gitlab # [ 7.302557] systemd[1]: Stopped target initrd-root-fs.target.658gitlab # [ 7.303296] systemd[1]: Stopped target initrd-switch-root.target.659gitlab # [ 7.304043] systemd[1]: Reached target Virtual Machines and Containers.660gitlab # [ 7.304921] systemd[1]: Reached target Path Units.661gitlab # [ 7.305795] systemd[1]: Reached target Remote File Systems.662gitlab # [ 7.306482] systemd[1]: Reached target Slice Units.663gitlab # [ 7.307242] systemd[1]: Reached target Swaps.664gitlab # [ 7.309912] systemd[1]: Listening on Query the User Interactively for a Password.665gitlab # [ 7.311976] systemd[1]: Listening on Process Core Dump Socket.666gitlab # [ 7.319200] systemd[1]: Listening on Credential Encryption/Decryption.667gitlab # [ 7.324094] systemd[1]: Listening on Factory Reset Management.668gitlab # [ 7.325621] systemd[1]: Listening on Hostname Service Socket.669gitlab # [ 7.336806] systemd[1]: Starting Journal Log Access Socket...670gitlab # [ 7.339416] systemd[1]: Listening on Journal Audit Socket.671gitlab # [ 7.341649] systemd[1]: Listening on Console Output Muting Service Socket.672gitlab # [ 7.342149] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.673gitlab # [ 7.342590] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os674gitlab # [ 7.343022] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki675gitlab # [ 7.345778] systemd[1]: Listening on Disk Repartitioning Service Socket.676gitlab # [ 7.346291] systemd[1]: Listening on udev Control Socket.677gitlab # [ 7.347041] systemd[1]: Listening on udev Varlink Socket.678gitlab # [ 7.353182] systemd[1]: Mounting Huge Pages File System...679gitlab # [ 7.360255] systemd[1]: Mounting POSIX Message Queue File System...680gitlab # [ 7.369138] systemd[1]: Mounting Kernel Debug File System...681gitlab # [ 7.382033] systemd[1]: Mounting Kernel Trace File System...682gitlab # [ 7.396376] systemd[1]: Starting Create List of Static Device Nodes...683gitlab # [ 7.407131] systemd[1]: Starting Load Kernel Module 9pnet_virtio...684gitlab # [ 7.408159] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs685gitlab # [ 7.417206] systemd[1]: Mounting Kernel Configuration File System...686gitlab # [ 7.418111] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm687gitlab # [ 7.418914] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore688gitlab # [ 7.425109] systemd[1]: Starting Load Kernel Module fuse...689gitlab # [ 7.426297] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67690gitlab # [ 7.431693] systemd[1]: Starting Journal Service...691gitlab # [ 7.438613] systemd[1]: Starting Load Kernel Modules...692gitlab # [ 7.444592] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...693gitlab # [ 7.456811] systemd[1]: Starting Remount Root and Kernel File Systems...694gitlab # [ 7.458956] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os695gitlab # [ 7.467602] systemd[1]: Starting Coldplug All udev Devices...696gitlab # [ 7.476365] fuse: init (API version 7.45)697gitlab # [ 7.484021] systemd[1]: Listening on Journal Log Access Socket.698gitlab # [ 7.485279] systemd[1]: Mounted Huge Pages File System.699gitlab # [ 7.486609] systemd[1]: Mounted POSIX Message Queue File System.700gitlab # [ 7.487959] systemd[1]: Mounted Kernel Debug File System.701gitlab # [ 7.489160] systemd-journald[317]: Collecting audit messages is enabled.702gitlab # [ 7.489200] systemd[1]: Mounted Kernel Trace File System.703gitlab # [ 7.491302] systemd[1]: Finished Create List of Static Device Nodes.704gitlab # [ 7.493015] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.705gitlab # [ 7.494389] systemd[1]: Finished Load Kernel Module 9pnet_virtio.706gitlab # [ 7.495668] systemd[1]: Mounted Kernel Configuration File System.707gitlab # [ 7.497302] systemd[1]: modprobe@fuse.service: Deactivated successfully.708gitlab # [ 7.498691] systemd[1]: Finished Load Kernel Module fuse.709gitlab # [ 7.500426] systemd[1]: Finished Load Kernel Modules.710gitlab # [ 7.505032] EXT4-fs (vda): re-mounted 424ce0df-75e7-485a-aa01-cf5f0d6e224b.711gitlab # [ 7.507208] systemd[1]: Mounting FUSE Control File System...712gitlab # [ 7.514029] systemd[1]: Starting Firewall...713gitlab # [ 7.522127] systemd[1]: Queued start job for default target Multi-User System.714gitlab # [ 7.525369] systemd[1]: Starting Apply Kernel Variables...715gitlab # [ 7.527622] systemd[1]: Unnecessary job was removed for /dev/vdb.716gitlab # [ 7.529077] systemd[1]: systemd-journald.service: Deactivated successfully.717gitlab # [ 7.530572] systemd-modules-load[318]: Using 3 probe threads718gitlab # [ 7.532057] systemd-modules-load[318]: Module 'atkbd' is built in719gitlab # [ 7.533280] systemd-modules-load[318]: Module 'loop' is built in720gitlab # [ 7.534460] systemd-modules-load[318]: Inserted module 'tls'721gitlab # [ 7.537767] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...722gitlab # [ 7.544488] systemd[1]: Started Journal Service.723gitlab # [ 7.550232] systemd[1]: Finished Remount Root and Kernel File Systems.724gitlab # [ 7.552439] systemd-oomd[320]: No swap; memory pressure usage will be degraded725gitlab # [ 7.555056] systemd[1]: Mounted FUSE Control File System.726gitlab # [ 7.557259] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.727gitlab # [ 7.563978] systemd[1]: Listening on Disk Image Download Service Socket.728gitlab # [ 7.567131] systemd[1]: Starting Flush Journal to Persistent Storage...729gitlab # [ 7.568658] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore730gitlab # [ 7.576243] systemd[1]: Starting Load/Save OS Random Seed...731gitlab # [ 7.577644] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os732gitlab # [ 7.599067] systemd[1]: Finished Apply Kernel Variables.733gitlab # [ 7.600714] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.734gitlab # [ 7.606252] systemd-journald[317]: Received client request to flush runtime journal.735gitlab # [ 7.639721] systemd[1]: Starting Create Static Device Nodes in /dev...736gitlab # [ 7.644143] systemd[1]: Finished Load/Save OS Random Seed.737gitlab # [ 7.645363] systemd[1]: Reached target First Boot Complete.738gitlab # [ 7.646484] systemd[1]: Finished Create Static Device Nodes in /dev.739gitlab # [ 7.647593] systemd[1]: Reached target Preparation for Local File Systems.740gitlab # [ 7.649030] systemd[1]: Starting Rule-based Manager for Device Events and Files...741gitlab # [ 7.650430] systemd[1]: Finished Flush Journal to Persistent Storage.742gitlab # [ 7.696849] systemd-udevd[365]: Using default interface naming scheme 'v261'.743gitlab # [ 7.735837] systemd[1]: Started Rule-based Manager for Device Events and Files.744gitlab # [ 8.068133] systemd[1]: Finished Firewall.745gitlab # [ 8.292757] systemd[1]: Mounting /run/wrappers...746gitlab # [ 8.317663] systemd[1]: Finished Coldplug All udev Devices.747gitlab # [ 8.339872] systemd[1]: Mounted /run/wrappers.748gitlab # [ 8.341493] systemd[1]: Reached target Local File Systems.749gitlab # [ 8.344040] systemd[1]: Listening on Boot Loader Control Service Socket.750gitlab # [ 8.348802] systemd[1]: Starting register-nix-paths.service...751gitlab # [ 8.356168] systemd[1]: Starting Create SUID/SGID Wrappers...752gitlab # [ 8.359064] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.753gitlab # [ 8.384492] systemd[1]: Starting Save Transient machine-id to Disk...754gitlab # [ 8.389285] systemd[1]: Starting Create System Files and Directories...755gitlab # [ 8.431551] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.756gitlab # [ 8.435726] systemd[1]: Finished Save Transient machine-id to Disk.757gitlab # [ 8.441182] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs758gitlab # [ 8.471970] systemd[1]: Finished Create System Files and Directories.759gitlab # [ 8.482553] systemd[1]: Starting Rebuild Journal Catalog...760gitlab # [ 8.488115] systemd[1]: Starting Record System Boot/Shutdown in UTMP...761gitlab # [ 8.525712] systemd[1]: Finished Record System Boot/Shutdown in UTMP.762gitlab # [ 8.547817] systemd[1]: Finished Rebuild Journal Catalog.763gitlab # [ 8.554585] systemd[1]: Starting Update is Completed...764gitlab # [ 8.559032] (udev-worker)[407]: Network interface NamePolicy= disabled on kernel command line.765gitlab # [ 8.563695] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped.766gitlab # [ 8.568663] (udev-worker)[485]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.767gitlab # [ 8.571130] (udev-worker)[485]: Network interface NamePolicy= disabled on kernel command line.768gitlab # [ 8.574049] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.769gitlab # [ 8.591010] systemd[1]: Condition check resulted in Virtio network device being skipped.770gitlab # [ 8.595358] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore771gitlab # [ 8.598200] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.772gitlab # [ 8.600111] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67773gitlab # [ 8.603053] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore774gitlab # [ 8.607499] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os775gitlab # [ 8.613214] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os776gitlab # [ 8.616093] systemd[1]: Finished Update is Completed.777gitlab # [ 8.617421] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.778gitlab # [ 8.618855] systemd[1]: Finished Create SUID/SGID Wrappers.779gitlab # [ 8.619774] systemd[1]: suid-sgid-wrappers.service: Consumed 159ms CPU time over 264ms wall clock time, 5.9M memory peak, 1.9M read from disk.780gitlab # [ 8.699401] mousedev: PS/2 mouse device common for all mice781gitlab # [ 8.861056] systemd[1]: Finished register-nix-paths.service.782gitlab # [ 8.862019] systemd[1]: Reached target System Initialization.783gitlab # [ 8.862892] systemd[1]: Started Discard unused filesystem blocks once a week.784gitlab # [ 8.864181] systemd[1]: Started logrotate.timer.785gitlab # [ 8.865184] systemd[1]: Started Daily Cleanup of Temporary Directories.786gitlab # [ 8.866539] systemd[1]: Reached target Timer Units.787gitlab # [ 8.867429] systemd[1]: Listening on D-Bus System Message Bus Socket.788gitlab # [ 8.868772] systemd[1]: Listening on Nix Daemon Socket.789gitlab # [ 8.881636] systemd[1]: Starting nixbot CI service socket...790gitlab # [ 8.884208] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.791gitlab # [ 8.887199] systemd[1]: Listening on nixbot CI service socket.792gitlab # [ 8.888334] systemd[1]: Reached target Socket Units.793gitlab # [ 8.889138] systemd[1]: Starting D-Bus System Message Bus...794gitlab # [ 8.922746] dbus-broker-launch[559]: Looking up NSS user entry for 'systemd-timesync'...795gitlab # [ 8.924307] dbus-broker-launch[559]: NSS returned no entry for 'systemd-timesync'796gitlab # [ 8.926572] dbus-broker-launch[559]: Invalid user-name in /nix/store/9zcyylhndlnizbwn48627991zr1jxg4p-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"797gitlab # [ 8.929883] systemd[1]: Started D-Bus System Message Bus.798gitlab # [ 8.938016] dbus-broker-launch[559]: Ready799gitlab # [ 8.939122] systemd[1]: Reached target Basic System.800gitlab # [ 8.941493] systemd[1]: Started backdoor.service.801gitlab # [ 8.944144] systemd[1]: Starting gitlab-config.service...802gitlab # [ 8.957947] systemd[1]: Starting Import lastlog data into lastlog2 database...803gitlab # [ 8.960428] systemd[1]: Starting Logrotate configuration check...804gitlab # [ 8.972241] systemd[1]: Starting Name Service Cache Daemon (nsncd)...805gitlab # [ 8.975936] logrotate[564]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.806gitlab # [ 8.980469] logrotate[564]: reading config file /nix/store/22afkmbkaxyx50bj9lbkkpmz7pd69hsf-logrotate.conf807gitlab # [ 8.981791] logrotate[564]: note: 'monthly' overrides previously specified 'weekly'808gitlab # [ 8.987259] systemd[1]: Starting Post-Boot Actions...809gitlab # [ 8.988146] logrotate[564]: Reading state from file: /var/lib/logrotate.status810gitlab # connecting to host...811gitlab # [ 8.991888] logrotate[564]: state file /var/lib/logrotate.status does not exist812gitlab # [ 8.993378] logrotate[564]: Allocating hash table for state file, size 64 entries813gitlab # [ 8.994497] logrotate[564]: Handling 4 logs814gitlab # [ 8.995460] logrotate[564]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed815gitlab # [ 8.998482] logrotate[564]: considering log /var/log/btmp816gitlab # [ 8.999210] logrotate[564]: Creating new state817gitlab # [ 8.999836] logrotate[564]: Now: 2026-08-15 09:29818gitlab # [ 9.000749] logrotate[564]: Last rotated at 2026-08-15 09:00819gitlab # [ 9.001529] logrotate[564]: log does not need rotating (log has already been rotated)820gitlab # [ 9.002561] logrotate[564]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed821gitlab: Guest shell says: b'Spawning backdoor root shell...\n'822gitlab # [ 9.005013] logrotate[564]: considering log /var/log/wtmp823gitlab # [ 9.014609] logrotate[564]: Creating new state824gitlab: connected to guest root shell825gitlab # [ 9.015191] logrotate[564]: Now: 2026-08-15 09:29826gitlab: (connecting took 9.45 seconds)827gitlab # [ 9.015795] logrotate[564]: Last rotated at 2026-08-15 09:00828gitlab: (finished: waiting for the VM to finish booting, in 9.45 seconds)829gitlab # [ 9.018878] logrotate[564]: log does not need rotating (log has already been rotated)830gitlab # [ 9.019992] logrotate[564]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed831gitlab # [ 9.022772] logrotate[564]: switching euid from 0 to 165 and egid from 0 to 165 (pid 564)832gitlab # [ 9.023748] logrotate[564]: considering log /var/gitlab/state/log/*.log833gitlab # [ 9.026159] logrotate[564]: log /var/gitlab/state/log/*.log does not exist -- skipping834gitlab # [ 9.027281] logrotate[564]: Creating new state835gitlab # [ 9.027914] logrotate[564]: switching euid from 165 to 0 and egid from 165 to 0 (pid 564)836gitlab # [ 9.029326] logrotate[564]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed837gitlab # [ 9.031571] logrotate[564]: switching euid from 0 to 60 and egid from 0 to 60 (pid 564)838gitlab # [ 9.032854] logrotate[564]: considering log /var/log/nginx/*.log839gitlab # [ 9.033748] logrotate[564]: log /var/log/nginx/*.log does not exist -- skipping840gitlab # [ 9.034722] logrotate[564]: Creating new state841gitlab # [ 9.035353] logrotate[564]: not running postrotate script, since no logs were rotated842gitlab # [ 9.036459] logrotate[564]: switching euid from 60 to 0 and egid from 60 to 0 (pid 564)843gitlab # [ 9.037693] systemd[1]: Started Reset console on configuration changes.844gitlab # [ 9.039045] nsncd[568]: Aug 15 09:29:12.868 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"845gitlab # [ 9.042154] systemd[1]: Starting resolvconf update...846gitlab # [ 9.043102] systemd[1]: Finished Logrotate configuration check.847gitlab # [ 9.044810] systemd[1]: Finished Post-Boot Actions.848gitlab # [ 9.045657] systemd[1]: Finished Import lastlog data into lastlog2 database.849gitlab # [ 9.046714] systemd[1]: Started Name Service Cache Daemon (nsncd).850gitlab # [ 9.047590] systemd[1]: Reached target Host and Network Name Lookups.851gitlab # [ 9.049958] systemd[1]: Reached target User and Group Name Lookups.852gitlab # [ 9.050987] systemd[1]: Starting User Login Management...853gitlab # [ 9.105295] systemd[1]: Stopped target Host and Network Name Lookups.854gitlab # [ 9.107085] systemd[1]: Stopping Host and Network Name Lookups...855gitlab # [ 9.108141] systemd[1]: Stopped target User and Group Name Lookups.856gitlab # [ 9.111028] systemd[1]: Stopping User and Group Name Lookups...857gitlab # [ 9.111945] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...858gitlab # [ 9.115610] systemd[1]: nscd.service: Deactivated successfully.859gitlab # [ 9.116532] systemd[1]: Stopped Name Service Cache Daemon (nsncd).860gitlab # [ 9.117434] systemd[1]: nscd.service: Consumed 23ms CPU time over 141ms wall clock time, 7.6M memory peak, 5.8M read from disk.861gitlab # [ 9.121215] systemd-logind[600]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)862gitlab # [ 9.122994] systemd-logind[600]: Watching system buttons on /dev/input/event0 (gpio-keys)863gitlab # [ 9.125545] systemd-logind[600]: New seat seat0.864gitlab # [ 9.126342] systemd[1]: Starting Name Service Cache Daemon (nsncd)...865gitlab # [ 9.127182] systemd[1]: Started User Login Management.866gitlab # [ 9.132623] systemd[1]: Starting linger-users.service...867gitlab # [ 9.151987] systemd[1]: linger-users.service: Deactivated successfully.868gitlab # [ 9.153134] systemd[1]: Finished linger-users.service.869gitlab # [ 9.155863] systemd[1]: Finished resolvconf update.870gitlab # [ 9.158575] systemd[1]: Reached target Preparation for Network.871gitlab # [ 9.162705] nsncd[656]: Aug 15 09:29:12.998 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"872gitlab # [ 9.166552] systemd[1]: Starting DHCP Client...873gitlab # [ 9.173014] systemd[1]: Starting Address configuration of eth1...874gitlab # [ 9.179689] systemd[1]: Starting Extra networking commands....875gitlab # [ 9.180693] systemd[1]: Started Name Service Cache Daemon (nsncd).876gitlab # [ 9.181533] systemd[1]: Reached target Host and Network Name Lookups.877gitlab # [ 9.182440] systemd[1]: Reached target User and Group Name Lookups.878gitlab # [ 9.211198] network-addresses-eth1-start[684]: adding address 192.168.1.1/24... done879gitlab # [ 9.216841] network-addresses-eth1-start[684]: adding address 2001:db8:1::1/64... done880gitlab # [ 9.223236] systemd[1]: Finished Address configuration of eth1.881gitlab # [ 9.322784] systemd[1]: Finished Extra networking commands..882gitlab # [ 9.323689] systemd[1]: Reached target Network.883gitlab # [ 9.362010] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3884gitlab # [ 9.368233] dhcpcd[701]: dhcpcd-10.3.2 starting885gitlab # [ 9.374033] dhcpcd[751]: dev: loaded udev886gitlab # [ 9.389431] systemd[1]: Starting gitlab-workhorse.service...887gitlab # [ 9.392772] systemd[1]: Starting Nginx Web Server...888gitlab # [ 9.408724] systemd[1]: Starting PostgreSQL Server...889gitlab # [ 9.414205] systemd[1]: Starting Redis Server - redis-gitlab...890gitlab # [ 9.420127] 8021q: 802.1Q VLAN Support v1.8891gitlab # [ 9.420488] 8021q: adding VLAN 0 to HW filter on device eth1892gitlab # [ 9.422352] systemd[1]: Starting Permit User Sessions...893gitlab # [ 9.456982] systemd[1]: Finished Permit User Sessions.894gitlab # [ 9.469467] systemd[1]: Started Getty on tty1.895gitlab # [ 9.470166] systemd[1]: Reached target Login Prompts.896gitlab # [ 9.489192] cfg80211: Loading compiled-in X.509 certificates for regulatory database897gitlab # [ 9.498233] systemd[1]: Starting Virtual Console Setup...898gitlab # [ 9.503924] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'899gitlab # [ 9.504420] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'900gitlab # [ 9.506122] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2901gitlab # [ 9.506453] cfg80211: failed to load regulatory.db902gitlab # [ 9.547180] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.903gitlab # [ 9.548855] systemd[1]: Stopped Virtual Console Setup.904gitlab # [ 9.555887] 8021q: adding VLAN 0 to HW filter on device eth0905gitlab # [ 9.557309] dhcpcd[751]: eth0: waiting for carrier906gitlab # [ 9.558066] dhcpcd[751]: eth0: carrier acquired907gitlab # [ 9.564987] dhcpcd[751]: DUID 00:01:00:01:32:12:ed:e9:52:54:00:12:34:56908gitlab # [ 9.567783] dhcpcd[751]: eth0: IAID 00:12:34:56909gitlab # [ 9.571623] dhcpcd[751]: eth0: adding address fe80::5054:ff:fe12:3456910gitlab # [ 9.580088] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.911gitlab # [ 9.586486] nginx-pre-start[786]: nginx: the configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf syntax is ok912gitlab # [ 9.591379] nginx-pre-start[786]: nginx: configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf test is successful913gitlab # [ 9.594479] systemd[1]: Starting Virtual Console Setup...914gitlab # [ 9.603697] systemd[1]: Started Nginx Web Server.915gitlab # [ 9.622912] systemd-logind[600]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)916gitlab # [ 9.642601] postgresql-pre-start[783]: The files belonging to this database system will be owned by user "postgres".917gitlab # [ 9.645560] postgresql-pre-start[783]: This user must also own the server process.918gitlab # [ 9.646674] postgresql-pre-start[783]: The database cluster will be initialized with locale "en_US.UTF-8".919gitlab # [ 9.648608] postgresql-pre-start[783]: The default database encoding has accordingly been set to "UTF8".920gitlab # [ 9.650125] postgresql-pre-start[783]: The default text search configuration will be set to "english".921gitlab # [ 9.651861] postgresql-pre-start[783]: Data page checksums are enabled.922gitlab # [ 9.653965] postgresql-pre-start[783]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok923gitlab # [ 9.659201] postgresql-pre-start[783]: creating subdirectories ... ok924gitlab # [ 9.660887] postgresql-pre-start[783]: selecting dynamic shared memory implementation ... posix925gitlab # [ 9.671670] systemd-vconsole-setup[798]: Configuration of first virtual console was skipped, ignoring remaining ones.926gitlab # [ 9.675570] systemd[1]: Finished Virtual Console Setup.927gitlab # [ 9.682192] redis-server[793]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.928gitlab # [ 9.685785] redis-server[793]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo929gitlab # [ 9.688179] redis-server[793]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=793, just started930gitlab # [ 9.689768] systemd[1]: Started Redis Server - redis-gitlab.931gitlab # [ 9.690725] postgresql-pre-start[783]: selecting default "max_connections" ... 100932gitlab # [ 9.691910] redis-server[793]: Configuration loaded933gitlab # [ 9.692929] redis[793]: monotonic clock: ARM CNTVCT @ 1000 ticks/us934gitlab # [ 9.693950] redis[793]: Running mode=standalone, port=0.935gitlab # [ 9.694852] redis[793]: Server initialized936gitlab # [ 9.695591] redis[793]: Ready to accept connections unix937gitlab # [ 9.696609] redis[793]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.938gitlab # [ 9.736927] postgresql-pre-start[783]: selecting default "shared_buffers" ... 128MB939gitlab # [ 10.071715] systemd[1]: Started gitlab-workhorse.service.940gitlab # [ 10.167951] dhcpcd[751]: eth0: soliciting a DHCP lease941gitlab # [ 10.180893] dhcpcd[751]: eth0: offered 10.0.2.15 from 10.0.2.2942gitlab # [ 10.189156] postgresql-pre-start[783]: selecting default time zone ... UTC943gitlab # [ 10.191042] postgresql-pre-start[783]: creating configuration files ... ok944gitlab # [ 10.196286] dhcpcd[751]: eth0: probing address 10.0.2.15/24945gitlab # [ 10.252740] gitlab-workhorse[821]: time="2026-08-15T09:29:14Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4946gitlab # [ 10.254938] gitlab-workhorse[821]: time="2026-08-15T09:29:14Z" level=info msg="Using redis/go-redis"947gitlab # [ 10.256304] gitlab-workhorse[821]: time="2026-08-15T09:29:14Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix948gitlab # [ 10.434220] postgresql-pre-start[783]: running bootstrap script ... ok949gitlab # [ 11.108592] postgresql-pre-start[783]: performing post-bootstrap initialization ... ok950gitlab # [ 11.437275] postgresql-pre-start[783]: syncing data to disk ... ok951gitlab # [ 11.439984] postgresql-pre-start[783]: initdb: warning: enabling "trust" authentication for local connections952gitlab # [ 11.443978] postgresql-pre-start[783]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.953gitlab # [ 11.450314] postgresql-pre-start[783]: Success. You can now start the database server using:954gitlab # [ 11.453921] postgresql-pre-start[783]: pg_ctl -D /var/lib/postgresql/18 -l logfile start955gitlab # [ 11.645529] postgres[854]: [854] LOG: starting PostgreSQL 18.4 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit956gitlab # [ 11.651083] postgres[854]: [854] LOG: listening on IPv6 address "::1", port 5432957gitlab # [ 11.654669] postgres[854]: [854] LOG: listening on IPv4 address "127.0.0.1", port 5432958gitlab # [ 11.659466] postgres[854]: [854] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"959gitlab # [ 11.665049] postgres[864]: [864] LOG: database system was shut down at 2026-08-15 09:29:14 GMT960gitlab # [ 11.674410] postgres[854]: [854] LOG: database system is ready to accept connections961gitlab # [ 11.679800] systemd[1]: Started PostgreSQL Server.962gitlab # [ 11.686949] systemd[1]: Starting PostgreSQL Setup Scripts...963gitlab # [ 11.998000] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[877]: mkdir -p /var/gitlab/state/home/.ssh: OK964gitlab # [ 12.002133] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[877]: chmod 700 /var/gitlab/state/home/.ssh: OK965gitlab # [ 12.048823] postgresql-setup-start[879]: CREATE DATABASE966gitlab # [ 12.092464] postgresql-setup-start[896]: CREATE ROLE967gitlab # [ 12.094795] systemd[1]: Finished gitlab-config.service.968gitlab # [ 12.101174] systemd[1]: Started gitaly.service.969gitlab # [ 12.117077] postgresql-setup-start[899]: ALTER DATABASE970gitlab # [ 12.166991] postgresql-setup-start[906]: CREATE ROLE971gitlab # [ 12.170504] systemd[1]: Finished PostgreSQL Setup Scripts.972gitlab # [ 12.173165] systemd[1]: Reached target PostgreSQL.973gitlab # [ 12.177997] systemd[1]: Starting gitlab-db-config.service...974gitlab # [ 12.185831] systemd[1]: Starting gitlab-postgresql.service...975gitlab # [ 12.333553] dhcpcd[751]: eth0: soliciting an IPv6 router976gitlab # [ 12.335941] dhcpcd[751]: eth0: Router Advertisement from fe80::2977gitlab # [ 12.338942] dhcpcd[751]: eth0: adding address fec0::5054:ff:fe12:3456/64978gitlab # [ 12.341698] dhcpcd[751]: eth0: adding route to fec0::/64979gitlab # [ 12.344111] dhcpcd[751]: eth0: adding default route via fe80::2980gitlab # [ 12.364463] gitlab-postgresql-start[920]: CREATE DATABASE981gitlab # [ 12.438881] gitlab-postgresql-start[936]: CREATE EXTENSION982gitlab # [ 12.532198] gitlab-postgresql-start[938]: CREATE EXTENSION983gitlab # [ 12.546671] systemd[1]: Finished gitlab-postgresql.service.984gitlab # [ 12.725699] gitaly[900]: time="2026-08-15T09:29:16.564Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/0r0qd84zrxhqq373hk9spv8j9pg0qlnq-gitaly.toml' and fix the errors that are printed." pid=900985gitlab # [ 12.737133] gitaly[900]: time="2026-08-15T09:29:16.564Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=900986gitlab # [ 12.742195] gitaly[900]: time="2026-08-15T09:29:16.564Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=900987gitlab # [ 12.760202] gitaly[900]: time="2026-08-15T09:29:16.564Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=900988gitlab # [ 12.765633] gitaly[900]: time="2026-08-15T09:29:16.564Z" level=info msg="Starting Gitaly" pid=900 version=989gitlab # [ 12.941956] gitaly[900]: time="2026-08-15T09:29:16.781Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=216 pid=900990gitlab # [ 12.944511] gitaly[900]: time="2026-08-15T09:29:16.783Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=900991gitlab # [ 12.946182] gitaly[900]: time="2026-08-15T09:29:16.783Z" level=info msg="finished initializing command factory" duration_ms=0 pid=900992gitlab # [ 12.947796] gitaly[900]: time="2026-08-15T09:29:16.783Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-900/git-exec-1003380140.d/git pid=900993gitlab # [ 12.950456] gitaly[900]: time="2026-08-15T09:29:16.789Z" level=info msg="finished detecting git version" duration_ms=5 pid=900994gitlab # [ 12.951902] gitaly[900]: time="2026-08-15T09:29:16.789Z" level=info msg="using Git version" pid=900 version=2.53.g995gitlab # [ 12.953347] gitaly[900]: time="2026-08-15T09:29:16.790Z" level=info msg="clearing disk cache object folder" pid=900 storage=default996gitlab # [ 12.954823] gitaly[900]: time="2026-08-15T09:29:16.790Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache594864609 pid=900 storage=default997gitlab # [ 12.957227] gitaly[900]: time="2026-08-15T09:29:16.790Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache594864609 pid=900 storage=default998gitlab # [ 12.959766] gitaly[900]: time="2026-08-15T09:29:16.790Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=900999gitlab # [ 12.962643] gitaly[900]: time="2026-08-15T09:29:16.790Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=9001000gitlab # [ 12.965439] gitaly[900]: time="2026-08-15T09:29:16.790Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache594864609 clear_duration_ms=0 pid=900 storage=default1001gitlab # [ 12.968316] gitaly[900]: time="2026-08-15T09:29:16.805Z" level=info msg="counting repositories" pid=9001002gitlab # [ 12.969499] gitaly[900]: time="2026-08-15T09:29:16.805Z" level=info msg="starting to count repositories" pid=900 storage_path=/var/gitlab/state/repositories1003gitlab # [ 12.971210] gitaly[900]: time="2026-08-15T09:29:16.805Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=900 storage_path=/var/gitlab/state/repositories1004gitlab # [ 12.973341] gitaly[900]: time="2026-08-15T09:29:16.805Z" level=info msg="completed counting all repositories" counting_duration=0 pid=9001005gitlab # [ 12.974853] gitaly[900]: time="2026-08-15T09:29:16.805Z" level=info msg="finished tempdir cleaner walk" pid=900 storage=default time_ms=01006gitlab # [ 12.976574] gitaly[900]: time="2026-08-15T09:29:16.805Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=9001007gitlab # [ 12.978608] gitaly[900]: time="2026-08-15T09:29:16.806Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=900 schema=unix1008gitlab # [ 12.980821] gitaly[900]: time="2026-08-15T09:29:16.806Z" level=info msg="listening at address" address=/run/gitaly/gitaly-900/sock.d/intern pid=900 schema=unix1009gitlab # [ 12.982568] gitaly[900]: time="2026-08-15T09:29:16.807Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9001010gitlab # [ 12.984257] gitaly[900]: time="2026-08-15T09:29:16.807Z" level=info msg="Started Gitaly" duration_ms=242 pid=9001011gitlab # [ 12.986053] gitaly[900]: time="2026-08-15T09:29:16.807Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9001012gitlab # [ 12.988323] gitaly[900]: time="2026-08-15T09:29:16.807Z" level=info msg="maintenance: daily scheduled" pid=900 scheduled="2026-08-15 12:00:00 +0000 UTC"1013gitlab # [ 13.484993] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[911]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1014gitlab # [ 13.488756] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[911]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1015gitlab # [ 13.505982] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[911]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1016gitlab # [ 15.193745] dhcpcd[751]: eth0: leased 10.0.2.15 for 86400 seconds1017gitlab # [ 15.196737] dhcpcd[751]: eth0: adding route to 10.0.2.0/241018gitlab # [ 15.199096] dhcpcd[751]: eth0: adding default route via 10.0.2.21019gitlab # [ 15.325267] systemd[1]: Started DHCP Client.1020gitlab # [ 15.327076] systemd[1]: Reached target Network is Online.1021gitlab # [ 16.353693] gitaly[900]: time="2026-08-15T09:29:20.192Z" level=info msg="License database preloaded" duration_ms=3627 pid=9001022gitlab # [ 57.197535] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[911]: W, [2026-08-15T09:30:01.035812 #911] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1023gitlab # [ 60.149529] postgres[1429]: [1429] ERROR: relation "feature_gates" does not exist at character 5231024gitlab # [ 60.149733] postgres[1429]: [1429] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1025gitlab # [ 60.149774] postgres[1429]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1026gitlab # [ 60.149815] postgres[1429]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1027gitlab # [ 60.149852] postgres[1429]: attidentity AS identity,1028gitlab # [ 60.149891] postgres[1429]: attgenerated as attgenerated1029gitlab # [ 60.149929] postgres[1429]: FROM pg_attribute a1030gitlab # [ 60.149980] postgres[1429]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1031gitlab # [ 60.150020] postgres[1429]: LEFT JOIN pg_type t ON a.atttypid = t.oid1032gitlab # [ 60.150059] postgres[1429]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1033gitlab # [ 60.150098] postgres[1429]: WHERE a.attrelid = '"feature_gates"'::regclass1034gitlab # [ 60.150135] postgres[1429]: AND a.attnum > 0 AND NOT a.attisdropped1035gitlab # [ 60.150173] postgres[1429]: ORDER BY a.attnum1036gitlab # [ 60.150205] postgres[1429]:1037gitlab # [ 60.312981] gitlab-workhorse[821]: time="2026-08-15T09:30:04Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1038gitlab # [ 65.203065] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1471]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1039gitlab # [ 65.203575] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1471]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1040gitlab # [ 70.323191] gitlab-workhorse[821]: time="2026-08-15T09:30:14Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1041gitlab # [ 80.330456] gitlab-workhorse[821]: time="2026-08-15T09:30:24Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1042gitlab # [ 90.338190] gitlab-workhorse[821]: time="2026-08-15T09:30:34Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1043gitlab # [ 91.532597] postgres[1583]: [1583] ERROR: relation "table_without_models" does not exist1044gitlab # [ 91.532974] postgres[1583]: [1583] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1045gitlab # [ 100.346574] gitlab-workhorse[821]: time="2026-08-15T09:30:44Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1046gitlab # [ 110.356747] gitlab-workhorse[821]: time="2026-08-15T09:30:54Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1047gitlab # [ 120.368547] gitlab-workhorse[821]: time="2026-08-15T09:31:04Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1048gitlab # [ 121.166604] systemd[1]: Finished gitlab-db-config.service.1049gitlab # [ 121.168782] systemd[1]: Started gitlab-sidekiq.service.1050gitlab # [ 121.172583] systemd[1]: Starting gitlab.service...1051gitlab # [ 121.753956] bundle[1949]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1052gitlab # [ 121.760354] bundle[1949]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1053gitlab # [ 121.766195] bundle[1949]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1054gitlab # [ 126.406729] bundle[1949]: {"timestamp":"2026-08-15T09:31:10.216Z","pid":1949,"message":"* Enabling systemd notification integration"}1055gitlab # [ 126.407162] bundle[1949]: {"timestamp":"2026-08-15T09:31:10.245Z","pid":1949,"message":"Puma starting in cluster mode..."}1056gitlab # [ 126.407298] bundle[1949]: {"timestamp":"2026-08-15T09:31:10.245Z","pid":1949,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1057gitlab # [ 126.407439] bundle[1949]: {"timestamp":"2026-08-15T09:31:10.245Z","pid":1949,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1058gitlab # [ 126.407570] bundle[1949]: {"timestamp":"2026-08-15T09:31:10.245Z","pid":1949,"message":"* Min threads: 0"}1059gitlab # [ 126.407670] bundle[1949]: {"timestamp":"2026-08-15T09:31:10.245Z","pid":1949,"message":"* Max threads: 4"}1060gitlab # [ 126.407784] bundle[1949]: {"timestamp":"2026-08-15T09:31:10.245Z","pid":1949,"message":"* Environment: production"}1061gitlab # [ 126.407899] bundle[1949]: {"timestamp":"2026-08-15T09:31:10.245Z","pid":1949,"message":"* Master PID: 1949"}1062gitlab # [ 126.442036] bundle[1949]: {"timestamp":"2026-08-15T09:31:10.245Z","pid":1949,"message":"* Workers: 2"}1063gitlab # [ 126.446058] bundle[1949]: {"timestamp":"2026-08-15T09:31:10.245Z","pid":1949,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1064gitlab # [ 126.452051] bundle[1949]: {"timestamp":"2026-08-15T09:31:10.245Z","pid":1949,"message":"* Preloading application"}1065gitlab # [ 126.456944] sidekiq-cluster[1948]: {"severity":"INFO","time":"2026-08-15T09:31:10.259Z","message":"Starting cluster with 1 processes"}1066gitlab # [ 130.370319] gitlab-workhorse[821]: time="2026-08-15T09:31:14Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1067gitlab # [ 140.371686] gitlab-workhorse[821]: time="2026-08-15T09:31:24Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1068gitlab # [ 150.382214] gitlab-workhorse[821]: time="2026-08-15T09:31:34Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1069gitlab # [ 160.390321] gitlab-workhorse[821]: time="2026-08-15T09:31:44Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1070gitlab # [ 164.633205] bundle[1949]: W, [2026-08-15T09:31:48.471670 #1949] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1071gitlab # [ 169.397995] sidekiq-cluster[1997]: 2026-08-15T09:31:53.236Z pid=1997 tid=wo5 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1997, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>433192960}1072gitlab # [ 169.672649] sidekiq-cluster[1997]: W, [2026-08-15T09:31:53.511967 #1997] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1073gitlab # [ 169.738620] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:53.578Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1074gitlab # [ 170.398174] gitlab-workhorse[821]: time="2026-08-15T09:31:54Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1075gitlab # [ 173.605487] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.443Z","message":"GitLab reliable fetch activated!"}1076gitlab # [ 173.605849] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.444Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1077gitlab # [ 173.638863] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.478Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1078gitlab # [ 173.646015] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.480Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1079gitlab # [ 173.653130] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.483Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1080gitlab # [ 173.659821] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.487Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1081gitlab # [ 173.667365] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.490Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1082gitlab # [ 173.674113] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.493Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1083gitlab # [ 173.680800] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.495Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1084gitlab # [ 173.686107] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.497Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1085gitlab # [ 173.691029] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.499Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1086gitlab # [ 173.695980] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.501Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1087gitlab # [ 173.700864] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.503Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1088gitlab # [ 173.705211] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.506Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1089gitlab # [ 173.708985] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.508Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1090gitlab # [ 173.712705] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.510Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1091gitlab # [ 173.716192] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.512Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1092gitlab # [ 173.719528] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.514Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1093gitlab # [ 173.722843] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.517Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1094gitlab # [ 173.725864] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.520Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1095gitlab # [ 173.729033] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.523Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1096gitlab # [ 173.731911] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.526Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1097gitlab # [ 173.735276] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.529Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1098gitlab # [ 173.738568] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.531Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1099gitlab # [ 173.741279] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.533Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1100gitlab # [ 173.743912] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.536Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1101gitlab # [ 173.746757] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.538Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1102gitlab # [ 173.749263] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.540Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1103gitlab # [ 173.751543] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.543Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1104gitlab # [ 173.754028] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.546Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1105gitlab # [ 173.756379] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.549Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1106gitlab # [ 173.758716] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.552Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1107gitlab # [ 173.760846] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.554Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1108gitlab # [ 173.763136] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.557Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1109gitlab # [ 173.765333] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.560Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1110gitlab # [ 173.767512] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.562Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1111gitlab # [ 173.769770] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.564Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1112gitlab # [ 173.771901] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.566Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1113gitlab # [ 173.774202] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.568Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1114gitlab # [ 173.776227] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.570Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1115gitlab # [ 173.778221] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.572Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1116gitlab # [ 173.780233] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.574Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1117gitlab # [ 173.782358] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.576Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1118gitlab # [ 173.784505] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.578Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1119gitlab # [ 173.786652] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.580Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1120gitlab # [ 173.788760] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.582Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1121gitlab # [ 173.790896] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.585Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1122gitlab # [ 173.793237] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.587Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1123gitlab # [ 173.795352] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.589Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1124gitlab # [ 173.797587] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.592Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1125gitlab # [ 173.799631] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.594Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1126gitlab # [ 173.802863] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.596Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1127gitlab # [ 173.805025] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.598Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1128gitlab # [ 173.807061] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.601Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1129gitlab # [ 173.809230] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.609Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1130gitlab # [ 173.811526] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.612Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1131gitlab # [ 173.813829] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.615Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1132gitlab # [ 173.815937] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.617Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1133gitlab # [ 173.818246] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.619Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1134gitlab # [ 173.820536] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.622Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1135gitlab # [ 173.822626] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.624Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1136gitlab # [ 173.824804] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.626Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1137gitlab # [ 173.826718] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.628Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1138gitlab # [ 173.828703] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.630Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1139gitlab # [ 173.830771] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.632Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1140gitlab # [ 173.833007] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.635Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1141gitlab # [ 173.835186] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.637Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1142gitlab # [ 173.837451] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.640Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1143gitlab # [ 173.839502] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.642Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1144gitlab # [ 173.841773] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.644Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1145gitlab # [ 173.844013] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.645Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1146gitlab # [ 173.846275] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.648Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1147gitlab # [ 173.848515] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.649Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1148gitlab # [ 173.850692] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.651Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1149gitlab # [ 173.852957] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.653Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1150gitlab # [ 173.855241] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.655Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1151gitlab # [ 173.857648] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.656Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1152gitlab # [ 173.859914] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.658Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1153gitlab # [ 173.862276] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.660Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1154gitlab # [ 173.864744] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.662Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1155gitlab # [ 173.866871] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.664Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1156gitlab # [ 173.869053] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.666Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1157gitlab # [ 173.871291] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.667Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1158gitlab # [ 173.873788] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.669Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1159gitlab # [ 173.875989] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.672Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1160gitlab # [ 173.878102] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.674Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1161gitlab # [ 173.880395] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.676Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1162gitlab # [ 173.882560] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.678Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1163gitlab # [ 173.885156] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.681Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1164gitlab # [ 173.887387] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.683Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1165gitlab # [ 173.889827] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.685Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1166gitlab # [ 173.892104] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.687Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1167gitlab # [ 173.894384] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.689Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1168gitlab # [ 173.896698] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.690Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1169gitlab # [ 173.898968] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.693Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1170gitlab # [ 173.901484] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.695Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1171gitlab # [ 173.903472] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.697Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1172gitlab # [ 173.905982] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.700Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1173gitlab # [ 173.908246] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.702Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1174gitlab # [ 173.910551] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.704Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1175gitlab # [ 173.912853] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.717Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1176gitlab # [ 173.915075] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.720Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1177gitlab # [ 173.917359] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.722Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1178gitlab # [ 173.919593] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.726Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1179gitlab # [ 173.921780] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.729Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1180gitlab # [ 173.923927] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.731Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1181gitlab # [ 173.926478] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.734Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1182gitlab # [ 173.928875] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.736Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1183gitlab # [ 173.930950] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.738Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1184gitlab # [ 173.933245] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.741Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1185gitlab # [ 173.935366] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:31:57.744Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1186gitlab # [ 180.401171] gitlab-workhorse[821]: time="2026-08-15T09:32:04Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1187gitlab # [ 190.402267] gitlab-workhorse[821]: time="2026-08-15T09:32:14Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1188gitlab # [ 200.410117] gitlab-workhorse[821]: time="2026-08-15T09:32:24Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1189gitlab # [ 210.418467] gitlab-workhorse[821]: time="2026-08-15T09:32:34Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1190gitlab # [ 212.617740] postgres[2725]: [2725] ERROR: relation "table_without_models" does not exist1191gitlab # [ 212.618151] postgres[2725]: [2725] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1192gitlab # [ 214.385140] postgres[2745]: [2745] ERROR: relation "table_without_models" does not exist1193gitlab # [ 214.385467] postgres[2745]: [2745] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1194gitlab # [ 217.627648] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:32:41.460Z","message":"Booted Rails 7.2.3.1 application in production environment"}1195gitlab # [ 217.627845] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:32:41.460Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1196gitlab # [ 217.627914] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:32:41.460Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1197gitlab # [ 217.627964] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:32:41.460Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1198gitlab # [ 217.631555] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:32:41.470Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1199gitlab # [ 220.352098] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:32:44.190Z","message":"Cleaning working queues"}1200gitlab # [ 220.353917] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:32:44.192Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"dc063a93203470b6c4de156f","created_at":"2026-08-15T09:31:04.353Z","trace_propagation_headers":{"sentry-trace":"990a113447f74bfba0f8acfab9879953-43050b8c301844d6","baggage":"sentry-trace_id=990a113447f74bfba0f8acfab9879953,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"8015847def5099ef10ab4af53701baff","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-15T09:31:04.365Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-dc063a93203470b6c4de156f: start","job_status":"start","queue_duration_s":99.827041,"scheduling_latency_s":99.827134}1201gitlab # [ 220.425757] gitlab-workhorse[821]: time="2026-08-15T09:32:44Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1202gitlab # [ 220.733269] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:32:44.571Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"dc063a93203470b6c4de156f","created_at":"2026-08-15T09:31:04.353Z","trace_propagation_headers":{"sentry-trace":"990a113447f74bfba0f8acfab9879953-43050b8c301844d6","baggage":"sentry-trace_id=990a113447f74bfba0f8acfab9879953,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"8015847def5099ef10ab4af53701baff","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-15T09:31:04.365Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-dc063a93203470b6c4de156f: done: 0.379186 sec","job_status":"done","queue_duration_s":99.827041,"scheduling_latency_s":99.827134,"redis_calls":29,"redis_duration_s":0.013404000000000001,"redis_read_bytes":282,"redis_write_bytes":3632,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.007694,"redis_feature_flag_read_bytes":272,"redis_feature_flag_write_bytes":2385,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003726,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001984,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":15,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.193454,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.19951576000000001,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.379186,"completed_at":"2026-08-15T09:32:44.571Z","load_balancing_strategy":"primary","db_duration_s":0.107452,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1203gitlab # [ 221.736314] bundle[1949]: {"timestamp":"2026-08-15T09:32:45.574Z","pid":1949,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1204gitlab # [ 221.736636] bundle[1949]: {"timestamp":"2026-08-15T09:32:45.574Z","pid":1949,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1205gitlab # [ 221.736818] bundle[1949]: {"timestamp":"2026-08-15T09:32:45.574Z","pid":1949,"message":"! #\u003cThread:0x0000f8c1ebf868c0 /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1206gitlab # [ 221.736933] bundle[1949]: {"timestamp":"2026-08-15T09:32:45.574Z","pid":1949,"message":"! #\u003cThread:0x0000f8c1ec19de38 /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1207gitlab # [ 221.737052] bundle[1949]: {"timestamp":"2026-08-15T09:32:45.575Z","pid":1949,"message":"Use Ctrl-C to stop"}1208gitlab # [ 221.737168] bundle[1949]: {"timestamp":"2026-08-15T09:32:45.575Z","pid":1949,"message":"Sending status to systemd every 1.0 sec"}1209gitlab # [ 224.884772] bundle[1949]: {"timestamp":"2026-08-15T09:32:48.722Z","pid":1949,"message":"- Worker 1 (PID: 2868) booted in 3.08s, phase: 0"}1210gitlab # [ 224.888445] bundle[1949]: {"timestamp":"2026-08-15T09:32:48.723Z","pid":1949,"message":"- Worker 0 (PID: 2864) booted in 3.11s, phase: 0"}1211gitlab # [ 224.893801] systemd[1]: Started gitlab.service.1212gitlab # [ 224.900845] systemd[1]: Reached target Common target for all GitLab services..1213gitlab # [ 224.903880] systemd[1]: Starting setup-gitlab.service...1214gitlab # [ 224.931046] setup-gitlab-start[2919]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1215gitlab # [ 226.010091] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:32:49 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 10321216gitlab # [ 226.014513] setup-gitlab-start[2919]: + TOKEN=nixbot-test-token-of-20-chars1217gitlab # [ 226.019019] setup-gitlab-start[2919]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1218gitlab # [ 226.035364] runuser[2933]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1219gitlab # [ 226.546498] setup-gitlab-start[2934]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1220gitlab # [ 226.553092] setup-gitlab-start[2934]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1221gitlab # [ 226.559422] setup-gitlab-start[2934]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1222gitlab # [ 227.433055] setup-gitlab-start[2934]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1223gitlab # [ 227.433394] setup-gitlab-start[2934]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1224gitlab # [ 227.435569] setup-gitlab-start[2934]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1225gitlab # [ 234.786257] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:32:58.622Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"1676d4d0930a5f8337d67a51","created_at":"2026-08-15T09:32:58.505Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e5d9011fd7fa2e8a94bc1e1cea07591e","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-15T09:32:58.618Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-1676d4d0930a5f8337d67a51: start","job_status":"start","queue_duration_s":0.003858,"scheduling_latency_s":0.003928}1226gitlab # [ 235.046958] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:32:58.885Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"1676d4d0930a5f8337d67a51","created_at":"2026-08-15T09:32:58.505Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e5d9011fd7fa2e8a94bc1e1cea07591e","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-15T09:32:58.618Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-1676d4d0930a5f8337d67a51: done: 0.262572 sec","job_status":"done","queue_duration_s":0.003858,"scheduling_latency_s":0.003928,"redis_calls":13,"redis_duration_s":0.033070999999999996,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0038,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.022372,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.006899,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.067863,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.03304298,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.262572,"completed_at":"2026-08-15T09:32:58.885Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.047376,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1227gitlab # [ 235.146902] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:32:58.912Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"e3886cb3d575a915c1522d09","created_at":"2026-08-15T09:32:58.678Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"efd98a7ef4b67ca31d0117197825c69c","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-15T09:32:58.694Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-e3886cb3d575a915c1522d09: start","job_status":"start","queue_duration_s":0.218177,"scheduling_latency_s":0.218228}1228gitlab # [ 235.210689] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:32:59.049Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"e3886cb3d575a915c1522d09","created_at":"2026-08-15T09:32:58.678Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"efd98a7ef4b67ca31d0117197825c69c","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-15T09:32:58.694Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-e3886cb3d575a915c1522d09: done: 0.13654 sec","job_status":"done","queue_duration_s":0.218177,"scheduling_latency_s":0.218228,"redis_calls":12,"redis_duration_s":0.026178,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001718,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.013576,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.010884,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.041,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.041,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037121,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00139756,"exclusive_lock_hold_duration_s":0.01419634,"duration_s":0.13654,"completed_at":"2026-08-15T09:32:59.048Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.047798,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1229gitlab # [ 235.278107] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:32:59.054Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"af3db092e14320c0ce94340a","created_at":"2026-08-15T09:32:58.716Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-15T09:32:58.739Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-af3db092e14320c0ce94340a: start","job_status":"start","queue_duration_s":0.314774,"scheduling_latency_s":0.314821}1230gitlab # [ 235.968945] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:32:59.806Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"af3db092e14320c0ce94340a","created_at":"2026-08-15T09:32:58.716Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-15T09:32:58.739Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-af3db092e14320c0ce94340a: done: 0.751392 sec","job_status":"done","queue_duration_s":0.314774,"scheduling_latency_s":0.314821,"redis_calls":71,"redis_duration_s":0.301755,"redis_read_bytes":120,"redis_write_bytes":42624,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.055045,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.003016,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.241242,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.002452,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.03,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.283581,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00175952,"duration_s":0.751392,"completed_at":"2026-08-15T09:32:59.805Z","load_balancing_strategy":"primary","db_duration_s":0.030324,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1231gitlab # [ 236.068934] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:32:59.812Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"b0c24058645d30ae6ef55801","created_at":"2026-08-15T09:32:58.760Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a8a85843c3694644a90d59f5821e0a93","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-15T09:32:58.774Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-b0c24058645d30ae6ef55801: start","job_status":"start","queue_duration_s":1.038186,"scheduling_latency_s":1.038239}1232gitlab # [ 236.125524] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:32:59.963Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"b0c24058645d30ae6ef55801","created_at":"2026-08-15T09:32:58.760Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a8a85843c3694644a90d59f5821e0a93","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-15T09:32:58.774Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-b0c24058645d30ae6ef55801: done: 0.151063 sec","job_status":"done","queue_duration_s":1.038186,"scheduling_latency_s":1.038239,"redis_calls":10,"redis_duration_s":0.01217,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001692,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00742,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003058,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.058,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.058,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041568,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00229114,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.151063,"completed_at":"2026-08-15T09:32:59.963Z","load_balancing_strategy":"primary","db_duration_s":0.0695,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1233gitlab # [ 236.231298] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:32:59.990Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"4c9e3e02ec41c0b4fe4b7f80","created_at":"2026-08-15T09:32:58.783Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"540abfc700aa7a3308395b2053db8687","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-15T09:32:58.824Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-4c9e3e02ec41c0b4fe4b7f80: start","job_status":"start","queue_duration_s":1.166516,"scheduling_latency_s":1.166563}1234gitlab # [ 236.248310] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:00.044Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1235gitlab # [ 236.251858] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:00.063Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"4c9e3e02ec41c0b4fe4b7f80","created_at":"2026-08-15T09:32:58.783Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"540abfc700aa7a3308395b2053db8687","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-15T09:32:58.824Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-4c9e3e02ec41c0b4fe4b7f80: done: 0.073187 sec","job_status":"done","queue_duration_s":1.166516,"scheduling_latency_s":1.166563,"redis_calls":10,"redis_duration_s":0.004308,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000796,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002657,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000855,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030741,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00062702,"duration_s":0.073187,"completed_at":"2026-08-15T09:33:00.063Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00078,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1236gitlab # [ 236.297759] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:00.066Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"0eb2feaf0b8e0681b85957d6","created_at":"2026-08-15T09:32:58.852Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e635121a11873fab02b9b369b5462d31","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-15T09:32:58.878Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-0eb2feaf0b8e0681b85957d6: start","job_status":"start","queue_duration_s":1.187887,"scheduling_latency_s":1.187917}1237gitlab # [ 236.586318] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:00.425Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"0eb2feaf0b8e0681b85957d6","created_at":"2026-08-15T09:32:58.852Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e635121a11873fab02b9b369b5462d31","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-15T09:32:58.878Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-0eb2feaf0b8e0681b85957d6: done: 0.358888 sec","job_status":"done","queue_duration_s":1.187887,"scheduling_latency_s":1.187917,"redis_calls":565,"redis_duration_s":0.08234999999999999,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000965,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001531,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.079854,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.310101,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026166,"duration_s":0.358888,"completed_at":"2026-08-15T09:33:00.425Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000526,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1238gitlab # [ 236.681855] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:00.426Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"9d840d62dcbabdf75e189c05","created_at":"2026-08-15T09:32:58.911Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dc69d517708287e795a04ff17c40ef34","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-15T09:32:58.940Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-9d840d62dcbabdf75e189c05: start","job_status":"start","queue_duration_s":1.486391,"scheduling_latency_s":1.48641}1239gitlab # [ 236.700590] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:00.509Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"9d840d62dcbabdf75e189c05","created_at":"2026-08-15T09:32:58.911Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dc69d517708287e795a04ff17c40ef34","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-15T09:32:58.940Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-9d840d62dcbabdf75e189c05: done: 0.082923 sec","job_status":"done","queue_duration_s":1.486391,"scheduling_latency_s":1.48641,"redis_calls":14,"redis_duration_s":0.003307,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00087,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00135,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001087,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.024,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049233,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0005549,"exclusive_lock_hold_duration_s":0.05887342,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.082923,"completed_at":"2026-08-15T09:33:00.509Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.02632,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1240gitlab # [ 236.751316] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:00.511Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"438c09b11eda4a574686b6a8","created_at":"2026-08-15T09:32:58.968Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2039d20354f98bef12367bf48d6fffc7","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-15T09:32:58.979Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-438c09b11eda4a574686b6a8: start","job_status":"start","queue_duration_s":1.531883,"scheduling_latency_s":1.531904}1241gitlab # [ 236.766808] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:00.537Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"438c09b11eda4a574686b6a8","created_at":"2026-08-15T09:32:58.968Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2039d20354f98bef12367bf48d6fffc7","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-15T09:32:58.979Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-438c09b11eda4a574686b6a8: done: 0.026663 sec","job_status":"done","queue_duration_s":1.531883,"scheduling_latency_s":1.531904,"redis_calls":10,"redis_duration_s":0.00243,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00049,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00143,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00051,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015565,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033058,"duration_s":0.026663,"completed_at":"2026-08-15T09:33:00.537Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002437,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1242gitlab # [ 236.808571] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:00.539Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"5be122ce64a65f2b9f2a94ef","created_at":"2026-08-15T09:32:58.990Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"ab80e12d768c5ce7b3f3137b8767d893","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.012Z","job_size_bytes":3,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-5be122ce64a65f2b9f2a94ef: start","job_status":"start","queue_duration_s":1.526691,"scheduling_latency_s":1.526707}1243gitlab # [ 236.822346] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:00.558Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"5be122ce64a65f2b9f2a94ef","created_at":"2026-08-15T09:32:58.990Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"ab80e12d768c5ce7b3f3137b8767d893","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.012Z","job_size_bytes":3,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-5be122ce64a65f2b9f2a94ef: done: 0.019335 sec","job_status":"done","queue_duration_s":1.526691,"scheduling_latency_s":1.526707,"redis_calls":10,"redis_duration_s":0.002294,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00049,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00133,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000474,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010895,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032066,"duration_s":0.019335,"completed_at":"2026-08-15T09:33:00.558Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000312,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1244gitlab # [ 236.863731] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:00.560Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"e1c9e57b9944125114609181","created_at":"2026-08-15T09:32:59.030Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"21643c7e337235840a59f39440dad944","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.057Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-e1c9e57b9944125114609181: start","job_status":"start","queue_duration_s":1.502682,"scheduling_latency_s":1.502699}1245gitlab # [ 236.878291] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:00.582Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"e1c9e57b9944125114609181","created_at":"2026-08-15T09:32:59.030Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"21643c7e337235840a59f39440dad944","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.057Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-e1c9e57b9944125114609181: done: 0.022402 sec","job_status":"done","queue_duration_s":1.502682,"scheduling_latency_s":1.502699,"redis_calls":12,"redis_duration_s":0.002789,"redis_read_bytes":11,"redis_write_bytes":1482,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000983,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001348,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000458,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013239,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003185,"duration_s":0.022402,"completed_at":"2026-08-15T09:33:00.582Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000621,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1246gitlab # [ 236.921297] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:00.584Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"00f3f0cb496d505f15ebc505","created_at":"2026-08-15T09:32:59.099Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c899c446d8ed0103d1f336558b2d1812","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.137Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-00f3f0cb496d505f15ebc505: start","job_status":"start","queue_duration_s":1.447333,"scheduling_latency_s":1.447349}1247gitlab # [ 236.935740] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:00.597Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1248gitlab # [ 236.939628] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:00.604Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"00f3f0cb496d505f15ebc505","created_at":"2026-08-15T09:32:59.099Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c899c446d8ed0103d1f336558b2d1812","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.137Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-00f3f0cb496d505f15ebc505: done: 0.020245 sec","job_status":"done","queue_duration_s":1.447333,"scheduling_latency_s":1.447349,"redis_calls":10,"redis_duration_s":0.0029059999999999997,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000461,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001966,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000479,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011228,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033922,"duration_s":0.020245,"completed_at":"2026-08-15T09:33:00.604Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000316,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1249gitlab # [ 236.982222] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:00.607Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"9a3daa5d3d61c7e900ae19c6","created_at":"2026-08-15T09:32:59.198Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d67c6123fc174e7fe6cb9cd686648860","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.232Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-9a3daa5d3d61c7e900ae19c6: start","job_status":"start","queue_duration_s":1.375736,"scheduling_latency_s":1.375755}1250gitlab # [ 236.996980] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:00.655Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"9a3daa5d3d61c7e900ae19c6","created_at":"2026-08-15T09:32:59.198Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d67c6123fc174e7fe6cb9cd686648860","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.232Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-9a3daa5d3d61c7e900ae19c6: done: 0.047299 sec","job_status":"done","queue_duration_s":1.375736,"scheduling_latency_s":1.375755,"redis_calls":12,"redis_duration_s":0.003382,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000478,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001762,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001142,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023592,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00064776,"exclusive_lock_hold_duration_s":0.0144528,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.047299,"completed_at":"2026-08-15T09:33:00.655Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016243,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1251gitlab # [ 237.041152] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:00.656Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"df5e566651c2407bf548363f","created_at":"2026-08-15T09:32:59.259Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f81fff691208b2c70d325b0d0fc364f4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-15T09:32:59.284Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-df5e566651c2407bf548363f: start","job_status":"start","queue_duration_s":1.372499,"scheduling_latency_s":1.372516}1252gitlab # [ 237.054017] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:00.688Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"df5e566651c2407bf548363f","created_at":"2026-08-15T09:32:59.259Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f81fff691208b2c70d325b0d0fc364f4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-15T09:32:59.284Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-df5e566651c2407bf548363f: done: 0.031788 sec","job_status":"done","queue_duration_s":1.372499,"scheduling_latency_s":1.372516,"redis_calls":10,"redis_duration_s":0.0015500000000000002,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00032,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000884,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000346,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021525,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022436,"duration_s":0.031788,"completed_at":"2026-08-15T09:33:00.688Z","load_balancing_strategy":"primary","db_duration_s":0.002849,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1253gitlab # [ 237.094496] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:00.689Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"1466239eb663f51bdef7f027","created_at":"2026-08-15T09:32:59.311Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7b52646e0679444369ba9a6389bd517e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.337Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-1466239eb663f51bdef7f027: start","job_status":"start","queue_duration_s":1.352227,"scheduling_latency_s":1.352245}1254gitlab # [ 237.107843] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:00.721Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"1466239eb663f51bdef7f027","created_at":"2026-08-15T09:32:59.311Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7b52646e0679444369ba9a6389bd517e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.337Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-1466239eb663f51bdef7f027: done: 0.032003 sec","job_status":"done","queue_duration_s":1.352227,"scheduling_latency_s":1.352245,"redis_calls":12,"redis_duration_s":0.002148,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000287,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001196,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000665,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017139,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00047022,"exclusive_lock_hold_duration_s":0.01244292,"duration_s":0.032003,"completed_at":"2026-08-15T09:33:00.721Z","load_balancing_strategy":"primary","db_duration_s":0.007972,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1255gitlab # [ 237.150321] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:00.723Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"d961a0866a805320c56a2cce","created_at":"2026-08-15T09:32:59.380Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"48a583a7667456581b45533015f89306","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.405Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-d961a0866a805320c56a2cce: start","job_status":"start","queue_duration_s":1.317416,"scheduling_latency_s":1.317434}1256gitlab # [ 237.164686] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:00.760Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"d961a0866a805320c56a2cce","created_at":"2026-08-15T09:32:59.380Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"48a583a7667456581b45533015f89306","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.405Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-d961a0866a805320c56a2cce: done: 0.037016 sec","job_status":"done","queue_duration_s":1.317416,"scheduling_latency_s":1.317434,"redis_calls":19,"redis_duration_s":0.002589,"redis_read_bytes":22,"redis_write_bytes":4785,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000589,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000208,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.001363,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000429,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026109,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022108,"duration_s":0.037016,"completed_at":"2026-08-15T09:33:00.760Z","load_balancing_strategy":"primary","db_duration_s":0.00337,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1257gitlab # [ 237.207179] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:00.761Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"ff3bc696fa2064f47f6ff7fe","created_at":"2026-08-15T09:32:59.449Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ac0cddeb1232b86fd116745e69570a23","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.472Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-ff3bc696fa2064f47f6ff7fe: start","job_status":"start","queue_duration_s":1.2885,"scheduling_latency_s":1.288517}1258gitlab # [ 237.221870] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:00.789Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"ff3bc696fa2064f47f6ff7fe","created_at":"2026-08-15T09:32:59.449Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ac0cddeb1232b86fd116745e69570a23","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.472Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-ff3bc696fa2064f47f6ff7fe: done: 0.028442 sec","job_status":"done","queue_duration_s":1.2885,"scheduling_latency_s":1.288517,"redis_calls":10,"redis_duration_s":0.00137,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00028,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000801,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000289,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016834,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00040058,"duration_s":0.028442,"completed_at":"2026-08-15T09:33:00.789Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005089,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1259gitlab # [ 237.263932] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:00.791Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"a0dd02bbacb30af097ad6611","created_at":"2026-08-15T09:32:59.494Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"21ffed87ae86da9521206ed20864fa4d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-15T09:32:59.518Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-a0dd02bbacb30af097ad6611: start","job_status":"start","queue_duration_s":1.272454,"scheduling_latency_s":1.272471}1260gitlab # [ 237.277884] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:00.802Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1261gitlab # [ 237.281719] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:00.809Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"a0dd02bbacb30af097ad6611","created_at":"2026-08-15T09:32:59.494Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"21ffed87ae86da9521206ed20864fa4d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-15T09:32:59.518Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-a0dd02bbacb30af097ad6611: done: 0.018615 sec","job_status":"done","queue_duration_s":1.272454,"scheduling_latency_s":1.272471,"redis_calls":10,"redis_duration_s":0.001331,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000307,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000743,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000281,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011038,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022304,"duration_s":0.018615,"completed_at":"2026-08-15T09:33:00.809Z","load_balancing_strategy":"primary","db_duration_s":0.000585,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1262gitlab # [ 237.324416] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:00.810Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleDeleteObjectsCronWorker","jid":"10569507f84dfa4d95b4df30","created_at":"2026-08-15T09:32:59.593Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8251d4193fad694e50c4958d17fdca56b6fb205fa6961a4b1ccb7cd497bc09c1","size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.623Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleDeleteObjectsCronWorker JID-10569507f84dfa4d95b4df30: start","job_status":"start","queue_duration_s":1.187819,"scheduling_latency_s":1.187836}1263gitlab # [ 237.339292] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:00.911Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleDeleteObjectsCronWorker","jid":"10569507f84dfa4d95b4df30","created_at":"2026-08-15T09:32:59.593Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8251d4193fad694e50c4958d17fdca56b6fb205fa6961a4b1ccb7cd497bc09c1","size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.623Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleDeleteObjectsCronWorker JID-10569507f84dfa4d95b4df30: done: 0.100458 sec","job_status":"done","queue_duration_s":1.187819,"scheduling_latency_s":1.187836,"redis_calls":65,"redis_duration_s":0.009505,"redis_read_bytes":115,"redis_write_bytes":41332,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000601,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":656,"redis_queues_calls":2,"redis_queues_duration_s":0.000552,"redis_queues_read_bytes":4,"redis_queues_write_bytes":37035,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.007934,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3374,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000418,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":267,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.088856,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022868,"duration_s":0.100458,"completed_at":"2026-08-15T09:33:00.911Z","load_balancing_strategy":"primary","db_duration_s":0.00103,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1264gitlab # [ 237.382666] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:00.912Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"4057afaec817ae21b8d054f8","created_at":"2026-08-15T09:32:59.633Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c14029856141692357d43999404d00e5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.655Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-4057afaec817ae21b8d054f8: start","job_status":"start","queue_duration_s":1.257312,"scheduling_latency_s":1.257331}1265gitlab # [ 237.397116] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.175Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"4057afaec817ae21b8d054f8","created_at":"2026-08-15T09:32:59.633Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c14029856141692357d43999404d00e5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.655Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-4057afaec817ae21b8d054f8: done: 0.262429 sec","job_status":"done","queue_duration_s":1.257312,"scheduling_latency_s":1.257331,"redis_calls":12,"redis_duration_s":0.001796,"redis_read_bytes":11,"redis_write_bytes":1370,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000262,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000798,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000736,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.053,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.053,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.190018,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00050892,"exclusive_lock_hold_duration_s":0.24063272000000002,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.262429,"completed_at":"2026-08-15T09:33:01.174Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.079425,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1266gitlab # [ 237.444035] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.176Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"a282e56bd9478e2d47bf28c8","created_at":"2026-08-15T09:32:59.677Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"35befd858d04c3e57d2d97532436124d","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.702Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-a282e56bd9478e2d47bf28c8: start","job_status":"start","queue_duration_s":1.474136,"scheduling_latency_s":1.474157}1267gitlab # [ 237.457976] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.200Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"a282e56bd9478e2d47bf28c8","created_at":"2026-08-15T09:32:59.677Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"35befd858d04c3e57d2d97532436124d","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.702Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-a282e56bd9478e2d47bf28c8: done: 0.024318 sec","job_status":"done","queue_duration_s":1.474136,"scheduling_latency_s":1.474157,"redis_calls":12,"redis_duration_s":0.0019450000000000001,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00028,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000796,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000869,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014235,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00045186,"exclusive_lock_hold_duration_s":0.0042403399999999996,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.024318,"completed_at":"2026-08-15T09:33:01.200Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002895,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1268gitlab # [ 237.501232] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.202Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"491eafb4c41295df67c400d4","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-491eafb4c41295df67c400d4: start","job_status":"start","queue_duration_s":1.457262,"scheduling_latency_s":1.457279}1269gitlab # [ 237.513479] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.224Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"491eafb4c41295df67c400d4","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-491eafb4c41295df67c400d4: done: 0.022315 sec","job_status":"done","queue_duration_s":1.457262,"scheduling_latency_s":1.457279,"redis_calls":16,"redis_duration_s":0.002152,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000288,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000606,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001258,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014152,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025764,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022315,"completed_at":"2026-08-15T09:33:01.224Z","load_balancing_strategy":"primary","db_duration_s":0.000652,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1270gitlab # [ 237.554982] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.225Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0aad0bf3e35af31b83397568","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0aad0bf3e35af31b83397568: start","job_status":"start","queue_duration_s":1.480865,"scheduling_latency_s":1.480882}1271gitlab # [ 237.567721] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.241Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0aad0bf3e35af31b83397568","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0aad0bf3e35af31b83397568: done: 0.015142 sec","job_status":"done","queue_duration_s":1.480865,"scheduling_latency_s":1.480882,"redis_calls":13,"redis_duration_s":0.0014399999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000911,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010266,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015142,"completed_at":"2026-08-15T09:33:01.241Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1272gitlab # [ 237.606857] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.242Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f95829e0b94ea52d8c7dcbc6","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f95829e0b94ea52d8c7dcbc6: start","job_status":"start","queue_duration_s":1.497233,"scheduling_latency_s":1.49725}1273gitlab # [ 237.619377] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.257Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f95829e0b94ea52d8c7dcbc6","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f95829e0b94ea52d8c7dcbc6: done: 0.014833 sec","job_status":"done","queue_duration_s":1.497233,"scheduling_latency_s":1.49725,"redis_calls":13,"redis_duration_s":0.001459,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000926,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010424,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014833,"completed_at":"2026-08-15T09:33:01.257Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1274gitlab # [ 237.658341] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.258Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33562165032269d82552adb2","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33562165032269d82552adb2: start","job_status":"start","queue_duration_s":1.513392,"scheduling_latency_s":1.513409}1275gitlab # [ 237.670777] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.273Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33562165032269d82552adb2","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33562165032269d82552adb2: done: 0.014812 sec","job_status":"done","queue_duration_s":1.513392,"scheduling_latency_s":1.513409,"redis_calls":13,"redis_duration_s":0.001472,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000956,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010407,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014812,"completed_at":"2026-08-15T09:33:01.273Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1276gitlab # [ 237.709639] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.274Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"67214d6417dbf6baab9bd482","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-67214d6417dbf6baab9bd482: start","job_status":"start","queue_duration_s":1.529427,"scheduling_latency_s":1.529444}1277gitlab # [ 237.722935] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.289Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"67214d6417dbf6baab9bd482","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-67214d6417dbf6baab9bd482: done: 0.01486 sec","job_status":"done","queue_duration_s":1.529427,"scheduling_latency_s":1.529444,"redis_calls":13,"redis_duration_s":0.001426,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000904,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010265,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01486,"completed_at":"2026-08-15T09:33:01.289Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1278gitlab # [ 237.761918] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.290Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f709c1e38ff25c1edf9e470","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f709c1e38ff25c1edf9e470: start","job_status":"start","queue_duration_s":1.545572,"scheduling_latency_s":1.54559}1279gitlab # [ 237.774116] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.305Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9f709c1e38ff25c1edf9e470","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9f709c1e38ff25c1edf9e470: done: 0.014806 sec","job_status":"done","queue_duration_s":1.545572,"scheduling_latency_s":1.54559,"redis_calls":13,"redis_duration_s":0.00147,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000944,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010464,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014806,"completed_at":"2026-08-15T09:33:01.305Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1280gitlab # [ 237.812952] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.306Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"38e089aef523bbd222807524","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-38e089aef523bbd222807524: start","job_status":"start","queue_duration_s":1.561512,"scheduling_latency_s":1.561529}1281gitlab # [ 237.825339] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.321Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"38e089aef523bbd222807524","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-38e089aef523bbd222807524: done: 0.015092 sec","job_status":"done","queue_duration_s":1.561512,"scheduling_latency_s":1.561529,"redis_calls":13,"redis_duration_s":0.001679,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000721,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000958,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010405,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015092,"completed_at":"2026-08-15T09:33:01.321Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1282gitlab # [ 237.864517] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.322Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c578aac93c3acea892b8b0c1","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c578aac93c3acea892b8b0c1: start","job_status":"start","queue_duration_s":1.577713,"scheduling_latency_s":1.577729}1283gitlab # [ 237.876836] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.337Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c578aac93c3acea892b8b0c1","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c578aac93c3acea892b8b0c1: done: 0.014963 sec","job_status":"done","queue_duration_s":1.577713,"scheduling_latency_s":1.577729,"redis_calls":13,"redis_duration_s":0.001478,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000957,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010437,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014963,"completed_at":"2026-08-15T09:33:01.337Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1284gitlab # [ 237.916164] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.338Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"362943b8f3b2b15bffcc696a","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-362943b8f3b2b15bffcc696a: start","job_status":"start","queue_duration_s":1.593903,"scheduling_latency_s":1.59392}1285gitlab # [ 237.930279] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.353Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"362943b8f3b2b15bffcc696a","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-362943b8f3b2b15bffcc696a: done: 0.014639 sec","job_status":"done","queue_duration_s":1.593903,"scheduling_latency_s":1.59392,"redis_calls":13,"redis_duration_s":0.00162,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001091,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009994,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014639,"completed_at":"2026-08-15T09:33:01.353Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1286gitlab # [ 237.970433] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.354Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b234d5fb5e3513a51f2dec8","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b234d5fb5e3513a51f2dec8: start","job_status":"start","queue_duration_s":1.609629,"scheduling_latency_s":1.609644}1287gitlab # [ 237.983221] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.369Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b234d5fb5e3513a51f2dec8","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b234d5fb5e3513a51f2dec8: done: 0.014926 sec","job_status":"done","queue_duration_s":1.609629,"scheduling_latency_s":1.609644,"redis_calls":13,"redis_duration_s":0.0015119999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000577,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000935,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010172,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014926,"completed_at":"2026-08-15T09:33:01.369Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1288gitlab # [ 238.022425] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.370Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"93e0704ac92723d0955765d8","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-93e0704ac92723d0955765d8: start","job_status":"start","queue_duration_s":1.625655,"scheduling_latency_s":1.625672}1289gitlab # [ 238.034634] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.385Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"93e0704ac92723d0955765d8","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-93e0704ac92723d0955765d8: done: 0.014514 sec","job_status":"done","queue_duration_s":1.625655,"scheduling_latency_s":1.625672,"redis_calls":13,"redis_duration_s":0.0014910000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000954,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009999,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014514,"completed_at":"2026-08-15T09:33:01.385Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1290gitlab # [ 238.073641] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.386Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28251d60b9c62760a3281ad1","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28251d60b9c62760a3281ad1: start","job_status":"start","queue_duration_s":1.641538,"scheduling_latency_s":1.641554}1291gitlab # [ 238.086044] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.401Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28251d60b9c62760a3281ad1","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28251d60b9c62760a3281ad1: done: 0.014599 sec","job_status":"done","queue_duration_s":1.641538,"scheduling_latency_s":1.641554,"redis_calls":13,"redis_duration_s":0.001448,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000934,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010126,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014599,"completed_at":"2026-08-15T09:33:01.401Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1292gitlab # [ 238.124691] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.402Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6aafd550982b3473baa3c360","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6aafd550982b3473baa3c360: start","job_status":"start","queue_duration_s":1.657344,"scheduling_latency_s":1.65736}1293gitlab # [ 238.138003] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.417Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6aafd550982b3473baa3c360","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6aafd550982b3473baa3c360: done: 0.014614 sec","job_status":"done","queue_duration_s":1.657344,"scheduling_latency_s":1.65736,"redis_calls":13,"redis_duration_s":0.001448,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000923,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010324,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014614,"completed_at":"2026-08-15T09:33:01.416Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1294gitlab # [ 238.176951] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.418Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"85f3b94653b10052a39536dd","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-85f3b94653b10052a39536dd: start","job_status":"start","queue_duration_s":1.673322,"scheduling_latency_s":1.673339}1295gitlab # [ 238.189240] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.433Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"85f3b94653b10052a39536dd","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-85f3b94653b10052a39536dd: done: 0.015048 sec","job_status":"done","queue_duration_s":1.673322,"scheduling_latency_s":1.673339,"redis_calls":13,"redis_duration_s":0.0014529999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000923,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010378,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015048,"completed_at":"2026-08-15T09:33:01.433Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1296gitlab # [ 238.228361] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.434Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fce125e4f55cc1117d9d1922","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fce125e4f55cc1117d9d1922: start","job_status":"start","queue_duration_s":1.689593,"scheduling_latency_s":1.68961}1297gitlab # [ 238.240375] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.449Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fce125e4f55cc1117d9d1922","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fce125e4f55cc1117d9d1922: done: 0.014597 sec","job_status":"done","queue_duration_s":1.689593,"scheduling_latency_s":1.68961,"redis_calls":13,"redis_duration_s":0.001422,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000519,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000903,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010131,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014597,"completed_at":"2026-08-15T09:33:01.449Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1298gitlab # [ 238.279195] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.450Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0451740c63eaaa9593c2a0ab","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0451740c63eaaa9593c2a0ab: start","job_status":"start","queue_duration_s":1.705493,"scheduling_latency_s":1.70551}1299gitlab # [ 238.291613] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.465Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0451740c63eaaa9593c2a0ab","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0451740c63eaaa9593c2a0ab: done: 0.014676 sec","job_status":"done","queue_duration_s":1.705493,"scheduling_latency_s":1.70551,"redis_calls":13,"redis_duration_s":0.0016640000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000717,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000947,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010349,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014676,"completed_at":"2026-08-15T09:33:01.465Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1300gitlab # [ 238.334488] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.466Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d66a9eb43eda15ba217f5188","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d66a9eb43eda15ba217f5188: start","job_status":"start","queue_duration_s":1.721267,"scheduling_latency_s":1.721284}1301gitlab # [ 238.347378] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.480Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d66a9eb43eda15ba217f5188","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d66a9eb43eda15ba217f5188: done: 0.014558 sec","job_status":"done","queue_duration_s":1.721267,"scheduling_latency_s":1.721284,"redis_calls":13,"redis_duration_s":0.0014190000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00092,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010155,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014558,"completed_at":"2026-08-15T09:33:01.480Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1302gitlab # [ 238.389085] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.482Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb277da76fd9a540c9f5d629","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb277da76fd9a540c9f5d629: start","job_status":"start","queue_duration_s":1.73691,"scheduling_latency_s":1.736926}1303gitlab # [ 238.401642] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.496Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb277da76fd9a540c9f5d629","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb277da76fd9a540c9f5d629: done: 0.014956 sec","job_status":"done","queue_duration_s":1.73691,"scheduling_latency_s":1.736926,"redis_calls":13,"redis_duration_s":0.001437,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000911,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010125,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014956,"completed_at":"2026-08-15T09:33:01.496Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1304gitlab # [ 238.442082] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.498Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3bac9456b8fa6a2b936bd3e8","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3bac9456b8fa6a2b936bd3e8: start","job_status":"start","queue_duration_s":1.752983,"scheduling_latency_s":1.753}1305gitlab # [ 238.455389] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.512Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3bac9456b8fa6a2b936bd3e8","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3bac9456b8fa6a2b936bd3e8: done: 0.014781 sec","job_status":"done","queue_duration_s":1.752983,"scheduling_latency_s":1.753,"redis_calls":13,"redis_duration_s":0.001444,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000912,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010039,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014781,"completed_at":"2026-08-15T09:33:01.512Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1306gitlab # [ 238.496425] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.513Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"34c4d102161143fe8c10a744","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-34c4d102161143fe8c10a744: start","job_status":"start","queue_duration_s":1.768807,"scheduling_latency_s":1.768823}1307gitlab # [ 238.508579] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.528Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"34c4d102161143fe8c10a744","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-34c4d102161143fe8c10a744: done: 0.014845 sec","job_status":"done","queue_duration_s":1.768807,"scheduling_latency_s":1.768823,"redis_calls":13,"redis_duration_s":0.0014320000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000904,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010057,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014845,"completed_at":"2026-08-15T09:33:01.528Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1308gitlab # [ 238.548879] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.529Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a29f0fb8b96ccea4503f91d4","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a29f0fb8b96ccea4503f91d4: start","job_status":"start","queue_duration_s":1.784793,"scheduling_latency_s":1.784809}1309gitlab # [ 238.561453] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.544Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a29f0fb8b96ccea4503f91d4","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a29f0fb8b96ccea4503f91d4: done: 0.014793 sec","job_status":"done","queue_duration_s":1.784793,"scheduling_latency_s":1.784809,"redis_calls":13,"redis_duration_s":0.001479,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000564,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000915,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010281,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014793,"completed_at":"2026-08-15T09:33:01.544Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1310gitlab # [ 238.600731] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.546Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0bf5a1940bd7faca2ce7eef8","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0bf5a1940bd7faca2ce7eef8: start","job_status":"start","queue_duration_s":1.80103,"scheduling_latency_s":1.801047}1311gitlab # [ 238.613055] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.560Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0bf5a1940bd7faca2ce7eef8","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0bf5a1940bd7faca2ce7eef8: done: 0.014482 sec","job_status":"done","queue_duration_s":1.80103,"scheduling_latency_s":1.801047,"redis_calls":13,"redis_duration_s":0.0014130000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000885,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010016,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014482,"completed_at":"2026-08-15T09:33:01.560Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1312gitlab # [ 238.654315] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.561Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7412977d153b7d5a1130aa5a","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7412977d153b7d5a1130aa5a: start","job_status":"start","queue_duration_s":1.816776,"scheduling_latency_s":1.816794}1313gitlab # [ 238.667532] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.576Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7412977d153b7d5a1130aa5a","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7412977d153b7d5a1130aa5a: done: 0.014591 sec","job_status":"done","queue_duration_s":1.816776,"scheduling_latency_s":1.816794,"redis_calls":13,"redis_duration_s":0.001457,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000935,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010273,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014591,"completed_at":"2026-08-15T09:33:01.576Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1314gitlab # [ 238.709707] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.577Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4c65b6802fbdaecfa0ff3d9","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4c65b6802fbdaecfa0ff3d9: start","job_status":"start","queue_duration_s":1.832643,"scheduling_latency_s":1.832659}1315gitlab # [ 238.722143] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.592Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4c65b6802fbdaecfa0ff3d9","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4c65b6802fbdaecfa0ff3d9: done: 0.014849 sec","job_status":"done","queue_duration_s":1.832643,"scheduling_latency_s":1.832659,"redis_calls":13,"redis_duration_s":0.001493,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000933,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010443,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014849,"completed_at":"2026-08-15T09:33:01.592Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1316gitlab # [ 238.762168] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.594Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea09fe66c8407a28dacdcae8","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea09fe66c8407a28dacdcae8: start","job_status":"start","queue_duration_s":1.849303,"scheduling_latency_s":1.84932}1317gitlab # [ 238.774543] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.608Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea09fe66c8407a28dacdcae8","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea09fe66c8407a28dacdcae8: done: 0.01446 sec","job_status":"done","queue_duration_s":1.849303,"scheduling_latency_s":1.84932,"redis_calls":13,"redis_duration_s":0.001401,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000885,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010141,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01446,"completed_at":"2026-08-15T09:33:01.608Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1318gitlab # [ 238.813902] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.610Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"10dd4ae8b4a6af4af0574efd","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-10dd4ae8b4a6af4af0574efd: start","job_status":"start","queue_duration_s":1.865016,"scheduling_latency_s":1.865033}1319gitlab # [ 238.826299] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.625Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"10dd4ae8b4a6af4af0574efd","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-10dd4ae8b4a6af4af0574efd: done: 0.014945 sec","job_status":"done","queue_duration_s":1.865016,"scheduling_latency_s":1.865033,"redis_calls":13,"redis_duration_s":0.001758,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001212,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010441,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014945,"completed_at":"2026-08-15T09:33:01.624Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1320gitlab # [ 238.865422] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.626Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70463dc8c3b9f05c403f3ffc","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70463dc8c3b9f05c403f3ffc: start","job_status":"start","queue_duration_s":1.881075,"scheduling_latency_s":1.881091}1321gitlab # [ 238.877909] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.640Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70463dc8c3b9f05c403f3ffc","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70463dc8c3b9f05c403f3ffc: done: 0.014645 sec","job_status":"done","queue_duration_s":1.881075,"scheduling_latency_s":1.881091,"redis_calls":13,"redis_duration_s":0.001423,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000912,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010126,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014645,"completed_at":"2026-08-15T09:33:01.640Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1322gitlab # [ 238.916953] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.641Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b3bd3905024f00364fab531","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b3bd3905024f00364fab531: start","job_status":"start","queue_duration_s":1.896794,"scheduling_latency_s":1.896811}1323gitlab # [ 238.929308] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.656Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b3bd3905024f00364fab531","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b3bd3905024f00364fab531: done: 0.014959 sec","job_status":"done","queue_duration_s":1.896794,"scheduling_latency_s":1.896811,"redis_calls":13,"redis_duration_s":0.001435,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000908,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010183,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014959,"completed_at":"2026-08-15T09:33:01.656Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1324gitlab # [ 238.969869] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.657Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"391b5dec081abfcb301b6a38","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-391b5dec081abfcb301b6a38: start","job_status":"start","queue_duration_s":1.912832,"scheduling_latency_s":1.912849}1325gitlab # [ 238.982082] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.672Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"391b5dec081abfcb301b6a38","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-391b5dec081abfcb301b6a38: done: 0.014937 sec","job_status":"done","queue_duration_s":1.912832,"scheduling_latency_s":1.912849,"redis_calls":13,"redis_duration_s":0.0015370000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000545,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000992,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010146,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014937,"completed_at":"2026-08-15T09:33:01.672Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1326gitlab # [ 239.021765] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.673Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"049015b4150284b4414a4b20","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-049015b4150284b4414a4b20: start","job_status":"start","queue_duration_s":1.928809,"scheduling_latency_s":1.928825}1327gitlab # [ 239.034571] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.688Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"049015b4150284b4414a4b20","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-049015b4150284b4414a4b20: done: 0.014586 sec","job_status":"done","queue_duration_s":1.928809,"scheduling_latency_s":1.928825,"redis_calls":13,"redis_duration_s":0.001612,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001071,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009949,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014586,"completed_at":"2026-08-15T09:33:01.688Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1328gitlab # [ 239.073657] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.690Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"723a6e31d16daba493c336b9","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-723a6e31d16daba493c336b9: start","job_status":"start","queue_duration_s":1.945762,"scheduling_latency_s":1.94578}1329gitlab # [ 239.086136] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.711Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"723a6e31d16daba493c336b9","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-723a6e31d16daba493c336b9: done: 0.020214 sec","job_status":"done","queue_duration_s":1.945762,"scheduling_latency_s":1.94578,"redis_calls":13,"redis_duration_s":0.00175,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001204,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010625,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020214,"completed_at":"2026-08-15T09:33:01.710Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1330gitlab # [ 239.125068] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.712Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2e7c1669b4d006e941403fd9","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2e7c1669b4d006e941403fd9: start","job_status":"start","queue_duration_s":1.967057,"scheduling_latency_s":1.967073}1331gitlab # [ 239.137449] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.727Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2e7c1669b4d006e941403fd9","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2e7c1669b4d006e941403fd9: done: 0.014904 sec","job_status":"done","queue_duration_s":1.967057,"scheduling_latency_s":1.967073,"redis_calls":13,"redis_duration_s":0.0016220000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00109,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010081,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014904,"completed_at":"2026-08-15T09:33:01.726Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1332gitlab # [ 239.177459] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.728Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce42d8ec1ad770c66cdb7034","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce42d8ec1ad770c66cdb7034: start","job_status":"start","queue_duration_s":1.983056,"scheduling_latency_s":1.983073}1333gitlab # [ 239.189715] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.743Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce42d8ec1ad770c66cdb7034","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce42d8ec1ad770c66cdb7034: done: 0.015335 sec","job_status":"done","queue_duration_s":1.983056,"scheduling_latency_s":1.983073,"redis_calls":13,"redis_duration_s":0.001595,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000571,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001024,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0105,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015335,"completed_at":"2026-08-15T09:33:01.743Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1334gitlab # [ 239.228713] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.744Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bc51a4683f2ce3937e413bcb","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bc51a4683f2ce3937e413bcb: start","job_status":"start","queue_duration_s":1.999538,"scheduling_latency_s":1.999554}1335gitlab # [ 239.241040] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.760Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bc51a4683f2ce3937e413bcb","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bc51a4683f2ce3937e413bcb: done: 0.015914 sec","job_status":"done","queue_duration_s":1.999538,"scheduling_latency_s":1.999554,"redis_calls":13,"redis_duration_s":0.001616,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00066,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000956,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010523,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015914,"completed_at":"2026-08-15T09:33:01.760Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1336gitlab # [ 239.280174] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.761Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb53adb16fd1038bd665379e","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb53adb16fd1038bd665379e: start","job_status":"start","queue_duration_s":2.016707,"scheduling_latency_s":2.016724}1337gitlab # [ 239.292524] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.777Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb53adb16fd1038bd665379e","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb53adb16fd1038bd665379e: done: 0.01559 sec","job_status":"done","queue_duration_s":2.016707,"scheduling_latency_s":2.016724,"redis_calls":13,"redis_duration_s":0.0017109999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000602,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001109,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01085,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01559,"completed_at":"2026-08-15T09:33:01.777Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1338gitlab # [ 239.331676] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.778Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c6bbca43345e42d30253626c","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c6bbca43345e42d30253626c: start","job_status":"start","queue_duration_s":2.033584,"scheduling_latency_s":2.033601}1339gitlab # [ 239.344412] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.793Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c6bbca43345e42d30253626c","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c6bbca43345e42d30253626c: done: 0.014724 sec","job_status":"done","queue_duration_s":2.033584,"scheduling_latency_s":2.033601,"redis_calls":13,"redis_duration_s":0.001513,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000563,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00095,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010396,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014724,"completed_at":"2026-08-15T09:33:01.793Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1340gitlab # [ 239.384543] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.794Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"112266e2157b70cda9ee371c","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-112266e2157b70cda9ee371c: start","job_status":"start","queue_duration_s":2.049634,"scheduling_latency_s":2.049654}1341gitlab # [ 239.396864] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.809Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"112266e2157b70cda9ee371c","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-112266e2157b70cda9ee371c: done: 0.014512 sec","job_status":"done","queue_duration_s":2.049634,"scheduling_latency_s":2.049654,"redis_calls":13,"redis_duration_s":0.001447,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000918,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010188,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014512,"completed_at":"2026-08-15T09:33:01.809Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1342gitlab # [ 239.436043] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.810Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d5b842dbbf3950d800ce5ae","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d5b842dbbf3950d800ce5ae: start","job_status":"start","queue_duration_s":2.065512,"scheduling_latency_s":2.065529}1343gitlab # [ 239.448263] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.825Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d5b842dbbf3950d800ce5ae","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d5b842dbbf3950d800ce5ae: done: 0.01481 sec","job_status":"done","queue_duration_s":2.065512,"scheduling_latency_s":2.065529,"redis_calls":13,"redis_duration_s":0.00145,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000907,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0104,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01481,"completed_at":"2026-08-15T09:33:01.825Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1344gitlab # [ 239.487550] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.826Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d3ed03d61283d8f3abc88ab","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d3ed03d61283d8f3abc88ab: start","job_status":"start","queue_duration_s":2.081533,"scheduling_latency_s":2.081551}1345gitlab # [ 239.499936] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.841Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d3ed03d61283d8f3abc88ab","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d3ed03d61283d8f3abc88ab: done: 0.014549 sec","job_status":"done","queue_duration_s":2.081533,"scheduling_latency_s":2.081551,"redis_calls":13,"redis_duration_s":0.001438,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000931,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010236,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014549,"completed_at":"2026-08-15T09:33:01.841Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1346gitlab # [ 239.539471] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.842Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b77c01812eda0d57d2e1064","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b77c01812eda0d57d2e1064: start","job_status":"start","queue_duration_s":2.097227,"scheduling_latency_s":2.097243}1347gitlab # [ 239.551938] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.857Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b77c01812eda0d57d2e1064","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b77c01812eda0d57d2e1064: done: 0.014757 sec","job_status":"done","queue_duration_s":2.097227,"scheduling_latency_s":2.097243,"redis_calls":13,"redis_duration_s":0.0016259999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000542,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001084,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010238,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014757,"completed_at":"2026-08-15T09:33:01.856Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1348gitlab # [ 239.595755] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.858Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f531b0ea1eddfc00a1a9baf","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f531b0ea1eddfc00a1a9baf: start","job_status":"start","queue_duration_s":2.113279,"scheduling_latency_s":2.113296}1349gitlab # [ 239.609028] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.872Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f531b0ea1eddfc00a1a9baf","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f531b0ea1eddfc00a1a9baf: done: 0.014643 sec","job_status":"done","queue_duration_s":2.113279,"scheduling_latency_s":2.113296,"redis_calls":13,"redis_duration_s":0.001601,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001076,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00997,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014643,"completed_at":"2026-08-15T09:33:01.872Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1350gitlab # [ 239.648099] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.874Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d817dc7726372afd47dd4072","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d817dc7726372afd47dd4072: start","job_status":"start","queue_duration_s":2.129003,"scheduling_latency_s":2.129019}1351gitlab # [ 239.660274] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.888Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d817dc7726372afd47dd4072","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d817dc7726372afd47dd4072: done: 0.014771 sec","job_status":"done","queue_duration_s":2.129003,"scheduling_latency_s":2.129019,"redis_calls":13,"redis_duration_s":0.001513,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010076,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014771,"completed_at":"2026-08-15T09:33:01.888Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1352gitlab # [ 239.701174] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.889Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb8ed2faa706e178ad4b4c6c","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb8ed2faa706e178ad4b4c6c: start","job_status":"start","queue_duration_s":2.144856,"scheduling_latency_s":2.144873}1353gitlab # [ 239.714107] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.904Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb8ed2faa706e178ad4b4c6c","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb8ed2faa706e178ad4b4c6c: done: 0.014512 sec","job_status":"done","queue_duration_s":2.144856,"scheduling_latency_s":2.144873,"redis_calls":13,"redis_duration_s":0.001592,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001062,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009897,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014512,"completed_at":"2026-08-15T09:33:01.904Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1354gitlab # [ 239.755505] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.905Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31eece8fa3f3a07ecfb2d70d","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31eece8fa3f3a07ecfb2d70d: start","job_status":"start","queue_duration_s":2.160402,"scheduling_latency_s":2.160418}1355gitlab # [ 239.768087] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.920Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31eece8fa3f3a07ecfb2d70d","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31eece8fa3f3a07ecfb2d70d: done: 0.014645 sec","job_status":"done","queue_duration_s":2.160402,"scheduling_latency_s":2.160418,"redis_calls":13,"redis_duration_s":0.0014190000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000892,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010001,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014645,"completed_at":"2026-08-15T09:33:01.920Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1356gitlab # [ 239.808438] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.921Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff241692f69392e0b16f805f","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff241692f69392e0b16f805f: start","job_status":"start","queue_duration_s":2.176282,"scheduling_latency_s":2.176299}1357gitlab # [ 239.821482] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.936Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff241692f69392e0b16f805f","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff241692f69392e0b16f805f: done: 0.015198 sec","job_status":"done","queue_duration_s":2.176282,"scheduling_latency_s":2.176299,"redis_calls":13,"redis_duration_s":0.001503,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000557,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000946,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010145,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015198,"completed_at":"2026-08-15T09:33:01.936Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1358gitlab # [ 239.860357] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.937Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd4ce48abbff81fa064bcb54","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd4ce48abbff81fa064bcb54: start","job_status":"start","queue_duration_s":2.192714,"scheduling_latency_s":2.192731}1359gitlab # [ 239.872453] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.952Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd4ce48abbff81fa064bcb54","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd4ce48abbff81fa064bcb54: done: 0.014459 sec","job_status":"done","queue_duration_s":2.192714,"scheduling_latency_s":2.192731,"redis_calls":13,"redis_duration_s":0.001591,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000673,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000918,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010162,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014459,"completed_at":"2026-08-15T09:33:01.952Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1360gitlab # [ 239.911925] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.953Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"330616ac79899c1ef6d39316","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-330616ac79899c1ef6d39316: start","job_status":"start","queue_duration_s":2.208426,"scheduling_latency_s":2.208443}1361gitlab # [ 239.924472] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.968Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"330616ac79899c1ef6d39316","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-330616ac79899c1ef6d39316: done: 0.014889 sec","job_status":"done","queue_duration_s":2.208426,"scheduling_latency_s":2.208443,"redis_calls":13,"redis_duration_s":0.0017180000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001159,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010291,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014889,"completed_at":"2026-08-15T09:33:01.968Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1362gitlab # [ 239.963403] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.969Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3fa69d3085b50848cf31693","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3fa69d3085b50848cf31693: start","job_status":"start","queue_duration_s":2.224702,"scheduling_latency_s":2.22472}1363gitlab # [ 239.977015] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.984Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3fa69d3085b50848cf31693","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3fa69d3085b50848cf31693: done: 0.014414 sec","job_status":"done","queue_duration_s":2.224702,"scheduling_latency_s":2.22472,"redis_calls":13,"redis_duration_s":0.001426,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000899,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010111,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014414,"completed_at":"2026-08-15T09:33:01.984Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1364gitlab # [ 240.016443] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.985Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5f75774e4f841686525ca046","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5f75774e4f841686525ca046: start","job_status":"start","queue_duration_s":2.240186,"scheduling_latency_s":2.240202}1365gitlab # [ 240.029283] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:01.999Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5f75774e4f841686525ca046","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5f75774e4f841686525ca046: done: 0.014583 sec","job_status":"done","queue_duration_s":2.240186,"scheduling_latency_s":2.240202,"redis_calls":13,"redis_duration_s":0.001444,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000519,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000925,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010154,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014583,"completed_at":"2026-08-15T09:33:01.999Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1366gitlab # [ 240.068275] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.000Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08fd22a6ce9506011e3d61ce","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08fd22a6ce9506011e3d61ce: start","job_status":"start","queue_duration_s":2.255823,"scheduling_latency_s":2.25584}1367gitlab # [ 240.080669] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.015Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"08fd22a6ce9506011e3d61ce","created_at":"2026-08-15T09:32:59.140Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-5cd1ad42add54745","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d3c2e6c82606fa02c01357d5a599150b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.745Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-08fd22a6ce9506011e3d61ce: done: 0.014838 sec","job_status":"done","queue_duration_s":2.255823,"scheduling_latency_s":2.25584,"redis_calls":13,"redis_duration_s":0.001511,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000998,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010318,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014838,"completed_at":"2026-08-15T09:33:02.015Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1368gitlab # [ 240.119624] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.016Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"9ab4f4f3a5a526fea2b30ed8","created_at":"2026-08-15T09:32:59.729Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2362d2fe5e9630dd8239044cddf8ba47","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.756Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-9ab4f4f3a5a526fea2b30ed8: start","job_status":"start","queue_duration_s":2.26069,"scheduling_latency_s":2.260706}1369gitlab # [ 240.133916] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.029Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1370gitlab # [ 240.137522] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.036Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"9ab4f4f3a5a526fea2b30ed8","created_at":"2026-08-15T09:32:59.729Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2362d2fe5e9630dd8239044cddf8ba47","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.756Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-9ab4f4f3a5a526fea2b30ed8: done: 0.019984 sec","job_status":"done","queue_duration_s":2.26069,"scheduling_latency_s":2.260706,"redis_calls":10,"redis_duration_s":0.001503,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000302,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000917,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000284,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011823,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023684,"duration_s":0.019984,"completed_at":"2026-08-15T09:33:02.036Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001332,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1371gitlab # [ 240.180232] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.038Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"c39175f005a96713ee9e3bfd","created_at":"2026-08-15T09:32:59.798Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"91105a6e46c562cc8c00bff5e62fdeba","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-15T09:32:59.819Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-c39175f005a96713ee9e3bfd: start","job_status":"start","queue_duration_s":2.218897,"scheduling_latency_s":2.218915}1372gitlab # [ 240.193587] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.049Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1373gitlab # [ 240.196886] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.056Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"c39175f005a96713ee9e3bfd","created_at":"2026-08-15T09:32:59.798Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"91105a6e46c562cc8c00bff5e62fdeba","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-15T09:32:59.819Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-c39175f005a96713ee9e3bfd: done: 0.018593 sec","job_status":"done","queue_duration_s":2.218897,"scheduling_latency_s":2.218915,"redis_calls":10,"redis_duration_s":0.001354,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000272,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000786,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000296,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01116,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004453,"duration_s":0.018593,"completed_at":"2026-08-15T09:33:02.056Z","load_balancing_strategy":"primary","db_duration_s":0.000666,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1374gitlab # [ 240.237831] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.058Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"76dd1899359237586c40cc77","created_at":"2026-08-15T09:32:59.860Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"11963d85fd57128d3985debe58bc5b0e","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.881Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-76dd1899359237586c40cc77: start","job_status":"start","queue_duration_s":2.17688,"scheduling_latency_s":2.176896}1375gitlab # [ 240.251005] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.077Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"76dd1899359237586c40cc77","created_at":"2026-08-15T09:32:59.860Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"11963d85fd57128d3985debe58bc5b0e","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.881Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-76dd1899359237586c40cc77: done: 0.019839 sec","job_status":"done","queue_duration_s":2.17688,"scheduling_latency_s":2.176896,"redis_calls":12,"redis_duration_s":0.001654,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000374,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000272,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000723,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000285,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011973,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00021926,"duration_s":0.019839,"completed_at":"2026-08-15T09:33:02.077Z","load_balancing_strategy":"primary","db_duration_s":0.00057,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1376gitlab # [ 240.293402] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.079Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"6e7935a6d841be9f64bbb498","created_at":"2026-08-15T09:32:59.888Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6fa30175c9389929c5b182e95c30334f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.900Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-6e7935a6d841be9f64bbb498: start","job_status":"start","queue_duration_s":2.17859,"scheduling_latency_s":2.178607}1377gitlab # [ 240.307516] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.090Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1378gitlab # [ 240.310851] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.097Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"6e7935a6d841be9f64bbb498","created_at":"2026-08-15T09:32:59.888Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6fa30175c9389929c5b182e95c30334f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.900Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-6e7935a6d841be9f64bbb498: done: 0.018233 sec","job_status":"done","queue_duration_s":2.17859,"scheduling_latency_s":2.178607,"redis_calls":10,"redis_duration_s":0.001343,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000291,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000763,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000289,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010917,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022628,"duration_s":0.018233,"completed_at":"2026-08-15T09:33:02.097Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000677,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1379gitlab # [ 240.352840] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.098Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"adaf9baaa494aba2166ee6df","created_at":"2026-08-15T09:32:59.933Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6598c1982944e9460dcfa6eb4e5dc822","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.959Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-adaf9baaa494aba2166ee6df: start","job_status":"start","queue_duration_s":2.139435,"scheduling_latency_s":2.139451}1380gitlab # [ 240.367404] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.117Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"adaf9baaa494aba2166ee6df","created_at":"2026-08-15T09:32:59.933Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6598c1982944e9460dcfa6eb4e5dc822","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.959Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-adaf9baaa494aba2166ee6df: done: 0.018921 sec","job_status":"done","queue_duration_s":2.139435,"scheduling_latency_s":2.139451,"redis_calls":10,"redis_duration_s":0.00134,"redis_read_bytes":9,"redis_write_bytes":1299,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000289,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000757,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000294,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011538,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00021994,"duration_s":0.018921,"completed_at":"2026-08-15T09:33:02.117Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000591,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1381gitlab # [ 240.410728] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.118Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"09440914f8f92ebacfdc9e4f","created_at":"2026-08-15T09:32:59.980Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ef96d73df357a2b1b0440218517ef693","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.996Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-09440914f8f92ebacfdc9e4f: start","job_status":"start","queue_duration_s":2.122505,"scheduling_latency_s":2.122523}1382gitlab # [ 240.424690] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.154Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"09440914f8f92ebacfdc9e4f","created_at":"2026-08-15T09:32:59.980Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ef96d73df357a2b1b0440218517ef693","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-15T09:32:59.996Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-09440914f8f92ebacfdc9e4f: done: 0.035496 sec","job_status":"done","queue_duration_s":2.122505,"scheduling_latency_s":2.122523,"redis_calls":16,"redis_duration_s":0.002504,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001296,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000739,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000469,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020757,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023978,"duration_s":0.035496,"completed_at":"2026-08-15T09:33:02.154Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008547,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1383gitlab # [ 240.466481] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.155Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ee0bf88e33c7faeeb55547e2","created_at":"2026-08-15T09:33:00.739Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-f5d4fd45f98c49f8","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"48a583a7667456581b45533015f89306","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.753Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ee0bf88e33c7faeeb55547e2: start","job_status":"start","queue_duration_s":1.402551,"scheduling_latency_s":1.402568}1384gitlab # [ 240.478846] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.172Z","message":"No existing merge request to be cleaned up."}1385gitlab # [ 240.480530] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.187Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ee0bf88e33c7faeeb55547e2","created_at":"2026-08-15T09:33:00.739Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-f5d4fd45f98c49f8","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"48a583a7667456581b45533015f89306","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.753Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ee0bf88e33c7faeeb55547e2: done: 0.031698 sec","job_status":"done","queue_duration_s":1.402551,"scheduling_latency_s":1.402568,"redis_calls":13,"redis_duration_s":0.001742,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0003,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000634,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000808,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019711,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022562,"duration_s":0.031698,"completed_at":"2026-08-15T09:33:02.187Z","load_balancing_strategy":"primary","db_duration_s":0.005617,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1386gitlab # [ 240.520307] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.188Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e4053dc672042a643ae6916c","created_at":"2026-08-15T09:33:00.739Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-f5d4fd45f98c49f8","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"48a583a7667456581b45533015f89306","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.753Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e4053dc672042a643ae6916c: start","job_status":"start","queue_duration_s":1.435323,"scheduling_latency_s":1.435341}1387gitlab # [ 240.532418] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.199Z","message":"No existing merge request to be cleaned up."}1388gitlab # [ 240.534034] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.208Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e4053dc672042a643ae6916c","created_at":"2026-08-15T09:33:00.739Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-f5d4fd45f98c49f8","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"48a583a7667456581b45533015f89306","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.753Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e4053dc672042a643ae6916c: done: 0.019687 sec","job_status":"done","queue_duration_s":1.435323,"scheduling_latency_s":1.435341,"redis_calls":10,"redis_duration_s":0.00134,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000569,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000771,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01364,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019687,"completed_at":"2026-08-15T09:33:02.207Z","load_balancing_strategy":"primary","db_duration_s":0.002532,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1389gitlab # [ 240.572149] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.209Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"70186c445924fc99a82e9d42","created_at":"2026-08-15T09:33:00.739Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-f5d4fd45f98c49f8","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"48a583a7667456581b45533015f89306","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.753Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-70186c445924fc99a82e9d42: start","job_status":"start","queue_duration_s":1.456086,"scheduling_latency_s":1.456102}1390gitlab # [ 240.585238] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.221Z","message":"No existing merge request to be cleaned up."}1391gitlab # [ 240.586872] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.239Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"70186c445924fc99a82e9d42","created_at":"2026-08-15T09:33:00.739Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-f5d4fd45f98c49f8","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"48a583a7667456581b45533015f89306","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.753Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-70186c445924fc99a82e9d42: done: 0.030357 sec","job_status":"done","queue_duration_s":1.456086,"scheduling_latency_s":1.456102,"redis_calls":10,"redis_duration_s":0.001887,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000971,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000916,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021084,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030357,"completed_at":"2026-08-15T09:33:02.239Z","load_balancing_strategy":"primary","db_duration_s":0.00432,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392gitlab # [ 240.626500] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.243Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"2a80c44614f1eb82ff31408a","created_at":"2026-08-15T09:33:00.739Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-f5d4fd45f98c49f8","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"48a583a7667456581b45533015f89306","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.753Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-2a80c44614f1eb82ff31408a: start","job_status":"start","queue_duration_s":1.489965,"scheduling_latency_s":1.490008}1393gitlab # [ 240.639597] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.269Z","message":"No existing merge request to be cleaned up."}1394gitlab # [ 240.641533] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.288Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"2a80c44614f1eb82ff31408a","created_at":"2026-08-15T09:33:00.739Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-f5d4fd45f98c49f8","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"48a583a7667456581b45533015f89306","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.753Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-2a80c44614f1eb82ff31408a: done: 0.04557 sec","job_status":"done","queue_duration_s":1.489965,"scheduling_latency_s":1.490008,"redis_calls":10,"redis_duration_s":0.003143,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001295,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001848,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033258,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.04557,"completed_at":"2026-08-15T09:33:02.288Z","load_balancing_strategy":"primary","db_duration_s":0.003302,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1395gitlab # [ 240.682178] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.291Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"13f25beb669d154b69ae2d8b","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-13f25beb669d154b69ae2d8b: start","job_status":"start","queue_duration_s":1.388437,"scheduling_latency_s":1.38847}1396gitlab # [ 240.694161] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.342Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"13f25beb669d154b69ae2d8b","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-13f25beb669d154b69ae2d8b: done: 0.051229 sec","job_status":"done","queue_duration_s":1.388437,"scheduling_latency_s":1.38847,"redis_calls":13,"redis_duration_s":0.004142,"redis_read_bytes":12,"redis_write_bytes":1300,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000617,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":289,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00171,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":395,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001815,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":616,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.01,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.01,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034124,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000421,"duration_s":0.051229,"completed_at":"2026-08-15T09:33:02.342Z","load_balancing_strategy":"primary","db_duration_s":0.006341,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1397gitlab # [ 240.733853] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.344Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"caa90e695f5fc1109f11289b","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-caa90e695f5fc1109f11289b: start","job_status":"start","queue_duration_s":1.44133,"scheduling_latency_s":1.44135}1398gitlab # [ 240.745969] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.367Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"caa90e695f5fc1109f11289b","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-caa90e695f5fc1109f11289b: done: 0.023494 sec","job_status":"done","queue_duration_s":1.44133,"scheduling_latency_s":1.44135,"redis_calls":10,"redis_duration_s":0.002657,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001031,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001626,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015992,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023494,"completed_at":"2026-08-15T09:33:02.367Z","load_balancing_strategy":"primary","db_duration_s":0.001623,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1399gitlab # [ 240.783787] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.369Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"62dc1146f84356b683967ff5","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-62dc1146f84356b683967ff5: start","job_status":"start","queue_duration_s":1.466695,"scheduling_latency_s":1.466714}1400gitlab # [ 240.797717] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.393Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"62dc1146f84356b683967ff5","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-62dc1146f84356b683967ff5: done: 0.023808 sec","job_status":"done","queue_duration_s":1.466695,"scheduling_latency_s":1.466714,"redis_calls":10,"redis_duration_s":0.0025009999999999998,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001017,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001484,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016427,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023808,"completed_at":"2026-08-15T09:33:02.393Z","load_balancing_strategy":"primary","db_duration_s":0.001559,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1401gitlab # [ 240.836089] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.395Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"27ef64e93716a8e44b1eba58","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-27ef64e93716a8e44b1eba58: start","job_status":"start","queue_duration_s":1.492223,"scheduling_latency_s":1.492241}1402gitlab # [ 240.848172] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.416Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"27ef64e93716a8e44b1eba58","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-27ef64e93716a8e44b1eba58: done: 0.021585 sec","job_status":"done","queue_duration_s":1.492223,"scheduling_latency_s":1.492241,"redis_calls":10,"redis_duration_s":0.002571,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001063,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001508,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014705,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021585,"completed_at":"2026-08-15T09:33:02.416Z","load_balancing_strategy":"primary","db_duration_s":0.001457,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1403gitlab # [ 240.886334] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.418Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"65ce557c0a1f3bebc0816ee2","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-65ce557c0a1f3bebc0816ee2: start","job_status":"start","queue_duration_s":1.515365,"scheduling_latency_s":1.515381}1404gitlab # [ 240.899292] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.437Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"65ce557c0a1f3bebc0816ee2","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-65ce557c0a1f3bebc0816ee2: done: 0.019483 sec","job_status":"done","queue_duration_s":1.515365,"scheduling_latency_s":1.515381,"redis_calls":10,"redis_duration_s":0.002881,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000965,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001916,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013085,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019483,"completed_at":"2026-08-15T09:33:02.437Z","load_balancing_strategy":"primary","db_duration_s":0.001209,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1405gitlab # [ 240.940274] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.439Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"908444c7f9bb1b4fcf14442b","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-908444c7f9bb1b4fcf14442b: start","job_status":"start","queue_duration_s":1.536525,"scheduling_latency_s":1.536541}1406gitlab # [ 240.952984] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.458Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"908444c7f9bb1b4fcf14442b","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-908444c7f9bb1b4fcf14442b: done: 0.019224 sec","job_status":"done","queue_duration_s":1.536525,"scheduling_latency_s":1.536541,"redis_calls":10,"redis_duration_s":0.0023179999999999997,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000969,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001349,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013384,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019224,"completed_at":"2026-08-15T09:33:02.458Z","load_balancing_strategy":"primary","db_duration_s":0.001192,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1407gitlab # [ 240.991224] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.460Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"a09873a882db4de0dcccf4af","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-a09873a882db4de0dcccf4af: start","job_status":"start","queue_duration_s":1.557203,"scheduling_latency_s":1.557218}1408gitlab # [ 241.004977] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.479Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"a09873a882db4de0dcccf4af","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-a09873a882db4de0dcccf4af: done: 0.019585 sec","job_status":"done","queue_duration_s":1.557203,"scheduling_latency_s":1.557218,"redis_calls":10,"redis_duration_s":0.0023940000000000003,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001002,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001392,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013337,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019585,"completed_at":"2026-08-15T09:33:02.479Z","load_balancing_strategy":"primary","db_duration_s":0.001243,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1409gitlab # [ 241.046466] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.481Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ef28bb766e2c04e5e92c1a62","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ef28bb766e2c04e5e92c1a62: start","job_status":"start","queue_duration_s":1.5783,"scheduling_latency_s":1.578314}1410gitlab # [ 241.059648] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.500Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ef28bb766e2c04e5e92c1a62","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ef28bb766e2c04e5e92c1a62: done: 0.019309 sec","job_status":"done","queue_duration_s":1.5783,"scheduling_latency_s":1.578314,"redis_calls":10,"redis_duration_s":0.0023090000000000003,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000962,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001347,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012991,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019309,"completed_at":"2026-08-15T09:33:02.500Z","load_balancing_strategy":"primary","db_duration_s":0.001176,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1411gitlab # [ 241.098184] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.501Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"829de22cfcfd8c01fa6fc8a0","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-829de22cfcfd8c01fa6fc8a0: start","job_status":"start","queue_duration_s":1.598969,"scheduling_latency_s":1.598985}1412gitlab # [ 241.110234] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.521Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"829de22cfcfd8c01fa6fc8a0","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-829de22cfcfd8c01fa6fc8a0: done: 0.019548 sec","job_status":"done","queue_duration_s":1.598969,"scheduling_latency_s":1.598985,"redis_calls":10,"redis_duration_s":0.0024590000000000002,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000992,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001467,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01328,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019548,"completed_at":"2026-08-15T09:33:02.521Z","load_balancing_strategy":"primary","db_duration_s":0.001287,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1413gitlab # [ 241.148744] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.524Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"9e687a15e9d48f8219f885eb","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-9e687a15e9d48f8219f885eb: start","job_status":"start","queue_duration_s":1.62112,"scheduling_latency_s":1.621138}1414gitlab # [ 241.161248] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.543Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"9e687a15e9d48f8219f885eb","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-9e687a15e9d48f8219f885eb: done: 0.019133 sec","job_status":"done","queue_duration_s":1.62112,"scheduling_latency_s":1.621138,"redis_calls":10,"redis_duration_s":0.002343,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00095,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001393,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012837,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019133,"completed_at":"2026-08-15T09:33:02.543Z","load_balancing_strategy":"primary","db_duration_s":0.001209,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1415gitlab # [ 241.199859] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.544Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"981b4fb33abdef8f92bb307e","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-981b4fb33abdef8f92bb307e: start","job_status":"start","queue_duration_s":1.642048,"scheduling_latency_s":1.642064}1416gitlab # [ 241.212883] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.564Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"981b4fb33abdef8f92bb307e","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-981b4fb33abdef8f92bb307e: done: 0.019315 sec","job_status":"done","queue_duration_s":1.642048,"scheduling_latency_s":1.642064,"redis_calls":10,"redis_duration_s":0.002403,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000976,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001427,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013471,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019315,"completed_at":"2026-08-15T09:33:02.564Z","load_balancing_strategy":"primary","db_duration_s":0.001254,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1417gitlab # [ 241.252099] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.565Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f988e46be6e57c406c2082e8","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f988e46be6e57c406c2082e8: start","job_status":"start","queue_duration_s":1.662868,"scheduling_latency_s":1.662885}1418gitlab # [ 241.264366] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.584Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f988e46be6e57c406c2082e8","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f988e46be6e57c406c2082e8: done: 0.018933 sec","job_status":"done","queue_duration_s":1.662868,"scheduling_latency_s":1.662885,"redis_calls":10,"redis_duration_s":0.002254,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000906,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001348,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012813,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018933,"completed_at":"2026-08-15T09:33:02.584Z","load_balancing_strategy":"primary","db_duration_s":0.00123,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1419gitlab # [ 241.302017] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.586Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"dbd0ec618c3d9b6880253cb5","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-dbd0ec618c3d9b6880253cb5: start","job_status":"start","queue_duration_s":1.683116,"scheduling_latency_s":1.683286}1420gitlab # [ 241.313880] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.606Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"dbd0ec618c3d9b6880253cb5","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-dbd0ec618c3d9b6880253cb5: done: 0.020525 sec","job_status":"done","queue_duration_s":1.683116,"scheduling_latency_s":1.683286,"redis_calls":10,"redis_duration_s":0.003242,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000991,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002251,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013572,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020525,"completed_at":"2026-08-15T09:33:02.606Z","load_balancing_strategy":"primary","db_duration_s":0.00124,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1421gitlab # [ 241.351484] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.608Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"235cc507e20c6f45750d1188","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-235cc507e20c6f45750d1188: start","job_status":"start","queue_duration_s":1.705161,"scheduling_latency_s":1.705178}1422gitlab # [ 241.363812] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.627Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"235cc507e20c6f45750d1188","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-235cc507e20c6f45750d1188: done: 0.019285 sec","job_status":"done","queue_duration_s":1.705161,"scheduling_latency_s":1.705178,"redis_calls":10,"redis_duration_s":0.0023699999999999997,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000962,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001408,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012904,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019285,"completed_at":"2026-08-15T09:33:02.627Z","load_balancing_strategy":"primary","db_duration_s":0.00122,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1423gitlab # [ 241.402850] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.629Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3b5cce7ccfce78d1200f88a5","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3b5cce7ccfce78d1200f88a5: start","job_status":"start","queue_duration_s":1.726337,"scheduling_latency_s":1.726354}1424gitlab # [ 241.414832] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.648Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3b5cce7ccfce78d1200f88a5","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3b5cce7ccfce78d1200f88a5: done: 0.019597 sec","job_status":"done","queue_duration_s":1.726337,"scheduling_latency_s":1.726354,"redis_calls":10,"redis_duration_s":0.00243,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001002,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001428,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013006,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019597,"completed_at":"2026-08-15T09:33:02.648Z","load_balancing_strategy":"primary","db_duration_s":0.001695,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1425gitlab # [ 241.453165] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.650Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"986dd272634cecf78e17a9bb","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-986dd272634cecf78e17a9bb: start","job_status":"start","queue_duration_s":1.747474,"scheduling_latency_s":1.747489}1426gitlab # [ 241.466288] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.669Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"986dd272634cecf78e17a9bb","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-986dd272634cecf78e17a9bb: done: 0.018793 sec","job_status":"done","queue_duration_s":1.747474,"scheduling_latency_s":1.747489,"redis_calls":10,"redis_duration_s":0.002321,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000938,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001383,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012869,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018793,"completed_at":"2026-08-15T09:33:02.669Z","load_balancing_strategy":"primary","db_duration_s":0.001175,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1427gitlab # [ 241.504465] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.670Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ead31d964e3f75b2063e8fdf","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ead31d964e3f75b2063e8fdf: start","job_status":"start","queue_duration_s":1.767788,"scheduling_latency_s":1.767804}1428gitlab # [ 241.516673] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.690Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ead31d964e3f75b2063e8fdf","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ead31d964e3f75b2063e8fdf: done: 0.019851 sec","job_status":"done","queue_duration_s":1.767788,"scheduling_latency_s":1.767804,"redis_calls":10,"redis_duration_s":0.002659,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001013,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001646,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013461,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019851,"completed_at":"2026-08-15T09:33:02.690Z","load_balancing_strategy":"primary","db_duration_s":0.001248,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1429gitlab # [ 241.555123] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.692Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f2f40b76a8692ef1982a4cfc","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f2f40b76a8692ef1982a4cfc: start","job_status":"start","queue_duration_s":1.789169,"scheduling_latency_s":1.789185}1430gitlab # [ 241.567438] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.711Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f2f40b76a8692ef1982a4cfc","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f2f40b76a8692ef1982a4cfc: done: 0.018985 sec","job_status":"done","queue_duration_s":1.789169,"scheduling_latency_s":1.789185,"redis_calls":10,"redis_duration_s":0.002306,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000959,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001347,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013297,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018985,"completed_at":"2026-08-15T09:33:02.710Z","load_balancing_strategy":"primary","db_duration_s":0.001235,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1431gitlab # [ 241.606729] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.712Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7dd146b8b68c96eb68d44d9d","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7dd146b8b68c96eb68d44d9d: start","job_status":"start","queue_duration_s":1.809835,"scheduling_latency_s":1.809851}1432gitlab # [ 241.619114] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.732Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7dd146b8b68c96eb68d44d9d","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7dd146b8b68c96eb68d44d9d: done: 0.019701 sec","job_status":"done","queue_duration_s":1.809835,"scheduling_latency_s":1.809851,"redis_calls":10,"redis_duration_s":0.0027400000000000002,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001031,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001709,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013448,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019701,"completed_at":"2026-08-15T09:33:02.732Z","load_balancing_strategy":"primary","db_duration_s":0.001193,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1433gitlab # [ 241.657719] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.733Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f863aa3c70974bf68438e724","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f863aa3c70974bf68438e724: start","job_status":"start","queue_duration_s":1.830932,"scheduling_latency_s":1.830948}1434gitlab # [ 241.669858] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.867Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f863aa3c70974bf68438e724","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f863aa3c70974bf68438e724: done: 0.13409 sec","job_status":"done","queue_duration_s":1.830932,"scheduling_latency_s":1.830948,"redis_calls":10,"redis_duration_s":0.004876999999999999,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000933,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003944,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.123906,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.13409,"completed_at":"2026-08-15T09:33:02.867Z","load_balancing_strategy":"primary","db_duration_s":0.001432,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1435gitlab # [ 241.708019] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.870Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3742dcffac050abfda9ae5b8","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3742dcffac050abfda9ae5b8: start","job_status":"start","queue_duration_s":1.968004,"scheduling_latency_s":1.968026}1436gitlab # [ 241.720182] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.892Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3742dcffac050abfda9ae5b8","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3742dcffac050abfda9ae5b8: done: 0.021128 sec","job_status":"done","queue_duration_s":1.968004,"scheduling_latency_s":1.968026,"redis_calls":10,"redis_duration_s":0.002667,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001079,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001588,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012976,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021128,"completed_at":"2026-08-15T09:33:02.891Z","load_balancing_strategy":"primary","db_duration_s":0.001362,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1437gitlab # [ 241.758578] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.893Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"2625d273e7e187db6059f308","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-2625d273e7e187db6059f308: start","job_status":"start","queue_duration_s":1.990653,"scheduling_latency_s":1.990668}1438gitlab # [ 241.770777] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.912Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"2625d273e7e187db6059f308","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-2625d273e7e187db6059f308: done: 0.019238 sec","job_status":"done","queue_duration_s":1.990653,"scheduling_latency_s":1.990668,"redis_calls":10,"redis_duration_s":0.00235,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000959,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001391,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013154,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019238,"completed_at":"2026-08-15T09:33:02.912Z","load_balancing_strategy":"primary","db_duration_s":0.001348,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1439gitlab # [ 241.810269] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.914Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"9a572ca3f53b0673c934c6a4","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-9a572ca3f53b0673c934c6a4: start","job_status":"start","queue_duration_s":2.011296,"scheduling_latency_s":2.011312}1440gitlab # [ 241.822471] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.933Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"9a572ca3f53b0673c934c6a4","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-9a572ca3f53b0673c934c6a4: done: 0.019438 sec","job_status":"done","queue_duration_s":2.011296,"scheduling_latency_s":2.011312,"redis_calls":10,"redis_duration_s":0.002872,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001425,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001447,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013079,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019438,"completed_at":"2026-08-15T09:33:02.933Z","load_balancing_strategy":"primary","db_duration_s":0.001208,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1441gitlab # [ 241.860813] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.935Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"cea173439e5efb06d60242d3","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-cea173439e5efb06d60242d3: start","job_status":"start","queue_duration_s":2.032365,"scheduling_latency_s":2.032382}1442gitlab # [ 241.872985] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.955Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"cea173439e5efb06d60242d3","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-cea173439e5efb06d60242d3: done: 0.019777 sec","job_status":"done","queue_duration_s":2.032365,"scheduling_latency_s":2.032382,"redis_calls":10,"redis_duration_s":0.00237,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000994,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001376,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012883,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019777,"completed_at":"2026-08-15T09:33:02.954Z","load_balancing_strategy":"primary","db_duration_s":0.001225,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1443gitlab # [ 241.911303] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.956Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ba4eafc27b88b369ec452cdf","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ba4eafc27b88b369ec452cdf: start","job_status":"start","queue_duration_s":2.053602,"scheduling_latency_s":2.053617}1444gitlab # [ 241.923641] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.975Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ba4eafc27b88b369ec452cdf","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ba4eafc27b88b369ec452cdf: done: 0.018773 sec","job_status":"done","queue_duration_s":2.053602,"scheduling_latency_s":2.053617,"redis_calls":10,"redis_duration_s":0.0024000000000000002,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000981,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001419,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012916,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018773,"completed_at":"2026-08-15T09:33:02.975Z","load_balancing_strategy":"primary","db_duration_s":0.001299,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1445gitlab # [ 241.962620] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.976Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"bae5024c63b268014043f41a","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-bae5024c63b268014043f41a: start","job_status":"start","queue_duration_s":2.073725,"scheduling_latency_s":2.073741}1446gitlab # [ 241.974808] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.995Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"bae5024c63b268014043f41a","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-bae5024c63b268014043f41a: done: 0.018987 sec","job_status":"done","queue_duration_s":2.073725,"scheduling_latency_s":2.073741,"redis_calls":10,"redis_duration_s":0.002341,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000972,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001369,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013109,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018987,"completed_at":"2026-08-15T09:33:02.995Z","load_balancing_strategy":"primary","db_duration_s":0.001213,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1447gitlab # [ 242.014040] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:02.997Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"fa352b78580b5fd99e813253","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-fa352b78580b5fd99e813253: start","job_status":"start","queue_duration_s":2.094159,"scheduling_latency_s":2.094175}1448gitlab # [ 242.026402] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.017Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"fa352b78580b5fd99e813253","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-fa352b78580b5fd99e813253: done: 0.020047 sec","job_status":"done","queue_duration_s":2.094159,"scheduling_latency_s":2.094175,"redis_calls":10,"redis_duration_s":0.00236,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001002,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001358,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012161,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020047,"completed_at":"2026-08-15T09:33:03.017Z","load_balancing_strategy":"primary","db_duration_s":0.001187,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1449gitlab # [ 242.065076] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.018Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5d0ec0e4324c600798b083c5","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5d0ec0e4324c600798b083c5: start","job_status":"start","queue_duration_s":2.115688,"scheduling_latency_s":2.115704}1450gitlab # [ 242.077035] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.037Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5d0ec0e4324c600798b083c5","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5d0ec0e4324c600798b083c5: done: 0.018951 sec","job_status":"done","queue_duration_s":2.115688,"scheduling_latency_s":2.115704,"redis_calls":10,"redis_duration_s":0.002319,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000962,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001357,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013062,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018951,"completed_at":"2026-08-15T09:33:03.037Z","load_balancing_strategy":"primary","db_duration_s":0.001225,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1451gitlab # [ 242.115579] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.038Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e15324152bdf347842e0705f","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e15324152bdf347842e0705f: start","job_status":"start","queue_duration_s":2.136007,"scheduling_latency_s":2.136021}1452gitlab # [ 242.128037] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.057Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e15324152bdf347842e0705f","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e15324152bdf347842e0705f: done: 0.019042 sec","job_status":"done","queue_duration_s":2.136007,"scheduling_latency_s":2.136021,"redis_calls":10,"redis_duration_s":0.002424,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001042,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001382,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01317,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019042,"completed_at":"2026-08-15T09:33:03.057Z","load_balancing_strategy":"primary","db_duration_s":0.001227,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1453gitlab # [ 242.166355] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.059Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"8c9ffb86ec29488c2ccc76c2","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-8c9ffb86ec29488c2ccc76c2: start","job_status":"start","queue_duration_s":2.156503,"scheduling_latency_s":2.156518}1454gitlab # [ 242.178795] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.079Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"8c9ffb86ec29488c2ccc76c2","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-8c9ffb86ec29488c2ccc76c2: done: 0.019614 sec","job_status":"done","queue_duration_s":2.156503,"scheduling_latency_s":2.156518,"redis_calls":10,"redis_duration_s":0.002332,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000988,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001344,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01278,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019614,"completed_at":"2026-08-15T09:33:03.078Z","load_balancing_strategy":"primary","db_duration_s":0.001218,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1455gitlab # [ 242.218991] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.080Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b4706f16081f16f20829cad9","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b4706f16081f16f20829cad9: start","job_status":"start","queue_duration_s":2.177506,"scheduling_latency_s":2.177522}1456gitlab # [ 242.231089] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.099Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b4706f16081f16f20829cad9","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b4706f16081f16f20829cad9: done: 0.018746 sec","job_status":"done","queue_duration_s":2.177506,"scheduling_latency_s":2.177522,"redis_calls":10,"redis_duration_s":0.00227,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000944,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001326,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01299,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018746,"completed_at":"2026-08-15T09:33:03.099Z","load_balancing_strategy":"primary","db_duration_s":0.001352,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1457gitlab # [ 242.269629] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.100Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b4dc385ed447a6a25980e091","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b4dc385ed447a6a25980e091: start","job_status":"start","queue_duration_s":2.197682,"scheduling_latency_s":2.197698}1458gitlab # [ 242.281894] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.119Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b4dc385ed447a6a25980e091","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b4dc385ed447a6a25980e091: done: 0.018853 sec","job_status":"done","queue_duration_s":2.197682,"scheduling_latency_s":2.197698,"redis_calls":10,"redis_duration_s":0.002421,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000984,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001437,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013018,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018853,"completed_at":"2026-08-15T09:33:03.119Z","load_balancing_strategy":"primary","db_duration_s":0.001243,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1459gitlab # [ 242.320121] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.120Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"62a2c1dff8c32313e282b773","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-62a2c1dff8c32313e282b773: start","job_status":"start","queue_duration_s":2.217927,"scheduling_latency_s":2.217943}1460gitlab # [ 242.332059] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.141Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"62a2c1dff8c32313e282b773","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-62a2c1dff8c32313e282b773: done: 0.020521 sec","job_status":"done","queue_duration_s":2.217927,"scheduling_latency_s":2.217943,"redis_calls":10,"redis_duration_s":0.002767,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000953,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001814,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013203,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020521,"completed_at":"2026-08-15T09:33:03.141Z","load_balancing_strategy":"primary","db_duration_s":0.00121,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1461gitlab # [ 242.372591] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.142Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"4d64bce33b96c7376f365ba2","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-4d64bce33b96c7376f365ba2: start","job_status":"start","queue_duration_s":2.239885,"scheduling_latency_s":2.239901}1462gitlab # [ 242.385469] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.162Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"4d64bce33b96c7376f365ba2","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-4d64bce33b96c7376f365ba2: done: 0.019487 sec","job_status":"done","queue_duration_s":2.239885,"scheduling_latency_s":2.239901,"redis_calls":10,"redis_duration_s":0.002399,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000983,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001416,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013595,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019487,"completed_at":"2026-08-15T09:33:03.162Z","load_balancing_strategy":"primary","db_duration_s":0.00146,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1463gitlab # [ 242.425830] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.163Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ded1f7beb14cf4c0ebf143b1","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ded1f7beb14cf4c0ebf143b1: start","job_status":"start","queue_duration_s":2.260819,"scheduling_latency_s":2.260835}1464gitlab # [ 242.438720] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.182Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ded1f7beb14cf4c0ebf143b1","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ded1f7beb14cf4c0ebf143b1: done: 0.019182 sec","job_status":"done","queue_duration_s":2.260819,"scheduling_latency_s":2.260835,"redis_calls":10,"redis_duration_s":0.002392,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000938,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001454,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013304,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019182,"completed_at":"2026-08-15T09:33:03.182Z","load_balancing_strategy":"primary","db_duration_s":0.001229,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1465gitlab # [ 242.476633] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.184Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f1abe8b34a121e4aa4ad9565","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f1abe8b34a121e4aa4ad9565: start","job_status":"start","queue_duration_s":2.28136,"scheduling_latency_s":2.281376}1466gitlab # [ 242.488451] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.204Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f1abe8b34a121e4aa4ad9565","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f1abe8b34a121e4aa4ad9565: done: 0.020416 sec","job_status":"done","queue_duration_s":2.28136,"scheduling_latency_s":2.281376,"redis_calls":10,"redis_duration_s":0.0023940000000000003,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001013,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001381,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013423,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020416,"completed_at":"2026-08-15T09:33:03.204Z","load_balancing_strategy":"primary","db_duration_s":0.001322,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1467gitlab # [ 242.526441] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.206Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"a94838032377007426459a52","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-a94838032377007426459a52: start","job_status":"start","queue_duration_s":2.303177,"scheduling_latency_s":2.303192}1468gitlab # [ 242.538576] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.224Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"a94838032377007426459a52","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-a94838032377007426459a52: done: 0.018657 sec","job_status":"done","queue_duration_s":2.303177,"scheduling_latency_s":2.303192,"redis_calls":10,"redis_duration_s":0.002322,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000966,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001356,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012831,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018657,"completed_at":"2026-08-15T09:33:03.224Z","load_balancing_strategy":"primary","db_duration_s":0.001279,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1469gitlab # [ 242.576489] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.226Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"2146e602f53e7e23c7af5f6e","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-2146e602f53e7e23c7af5f6e: start","job_status":"start","queue_duration_s":2.323181,"scheduling_latency_s":2.323197}1470gitlab # [ 242.588495] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.245Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"2146e602f53e7e23c7af5f6e","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-2146e602f53e7e23c7af5f6e: done: 0.019443 sec","job_status":"done","queue_duration_s":2.323181,"scheduling_latency_s":2.323197,"redis_calls":10,"redis_duration_s":0.002921,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001001,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00192,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013189,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019443,"completed_at":"2026-08-15T09:33:03.245Z","load_balancing_strategy":"primary","db_duration_s":0.001274,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1471gitlab # [ 242.627237] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.247Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"68ea72c557fa802f828361f2","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-68ea72c557fa802f828361f2: start","job_status":"start","queue_duration_s":2.34462,"scheduling_latency_s":2.34464}1472gitlab # [ 242.639528] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.266Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"68ea72c557fa802f828361f2","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-68ea72c557fa802f828361f2: done: 0.019501 sec","job_status":"done","queue_duration_s":2.34462,"scheduling_latency_s":2.34464,"redis_calls":10,"redis_duration_s":0.002327,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000958,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001369,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012929,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019501,"completed_at":"2026-08-15T09:33:03.266Z","load_balancing_strategy":"primary","db_duration_s":0.001208,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1473gitlab # [ 242.677817] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.267Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7d1d645b20a04e176c1e6ed8","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7d1d645b20a04e176c1e6ed8: start","job_status":"start","queue_duration_s":2.364852,"scheduling_latency_s":2.364868}1474gitlab # [ 242.689940] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.287Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7d1d645b20a04e176c1e6ed8","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7d1d645b20a04e176c1e6ed8: done: 0.019331 sec","job_status":"done","queue_duration_s":2.364852,"scheduling_latency_s":2.364868,"redis_calls":10,"redis_duration_s":0.002387,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000966,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001421,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013579,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019331,"completed_at":"2026-08-15T09:33:03.287Z","load_balancing_strategy":"primary","db_duration_s":0.001285,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1475gitlab # [ 242.727853] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.288Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"688ee6c2f1cb262e281a8a98","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-688ee6c2f1cb262e281a8a98: start","job_status":"start","queue_duration_s":2.385615,"scheduling_latency_s":2.385631}1476gitlab # [ 242.739948] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.309Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"688ee6c2f1cb262e281a8a98","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-688ee6c2f1cb262e281a8a98: done: 0.021425 sec","job_status":"done","queue_duration_s":2.385615,"scheduling_latency_s":2.385631,"redis_calls":10,"redis_duration_s":0.002304,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000953,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001351,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012549,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021425,"completed_at":"2026-08-15T09:33:03.309Z","load_balancing_strategy":"primary","db_duration_s":0.001276,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1477gitlab # [ 242.778155] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.311Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ebcf1fe89ef17f29a1670cde","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ebcf1fe89ef17f29a1670cde: start","job_status":"start","queue_duration_s":2.408444,"scheduling_latency_s":2.408459}1478gitlab # [ 242.790323] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.331Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"ebcf1fe89ef17f29a1670cde","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-ebcf1fe89ef17f29a1670cde: done: 0.019956 sec","job_status":"done","queue_duration_s":2.408444,"scheduling_latency_s":2.408459,"redis_calls":10,"redis_duration_s":0.002451,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00097,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001481,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014066,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019956,"completed_at":"2026-08-15T09:33:03.331Z","load_balancing_strategy":"primary","db_duration_s":0.001559,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1479gitlab # [ 242.828167] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.332Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5ee80370025ec30140b89f54","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5ee80370025ec30140b89f54: start","job_status":"start","queue_duration_s":2.429657,"scheduling_latency_s":2.429673}1480gitlab # [ 242.840887] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.352Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"5ee80370025ec30140b89f54","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-5ee80370025ec30140b89f54: done: 0.019935 sec","job_status":"done","queue_duration_s":2.429657,"scheduling_latency_s":2.429673,"redis_calls":10,"redis_duration_s":0.002311,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000956,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001355,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013668,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019935,"completed_at":"2026-08-15T09:33:03.352Z","load_balancing_strategy":"primary","db_duration_s":0.001306,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1481gitlab # [ 242.878875] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.354Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"55b51879aa272d68c5df2949","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-55b51879aa272d68c5df2949: start","job_status":"start","queue_duration_s":2.451847,"scheduling_latency_s":2.451866}1482gitlab # [ 242.891103] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.374Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"55b51879aa272d68c5df2949","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-55b51879aa272d68c5df2949: done: 0.019922 sec","job_status":"done","queue_duration_s":2.451847,"scheduling_latency_s":2.451866,"redis_calls":10,"redis_duration_s":0.002369,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000979,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00139,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013788,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019922,"completed_at":"2026-08-15T09:33:03.374Z","load_balancing_strategy":"primary","db_duration_s":0.001329,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1483gitlab # [ 242.930057] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.376Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"69111f764c972b13935fcc1a","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-69111f764c972b13935fcc1a: start","job_status":"start","queue_duration_s":2.473254,"scheduling_latency_s":2.47327}1484gitlab # [ 242.967012] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.395Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"69111f764c972b13935fcc1a","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-69111f764c972b13935fcc1a: done: 0.019164 sec","job_status":"done","queue_duration_s":2.473254,"scheduling_latency_s":2.47327,"redis_calls":10,"redis_duration_s":0.002379,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000971,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001408,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013235,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019164,"completed_at":"2026-08-15T09:33:03.395Z","load_balancing_strategy":"primary","db_duration_s":0.00125,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1485gitlab # [ 243.037253] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.396Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"bc8eda3d49e81a8213ee2679","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-bc8eda3d49e81a8213ee2679: start","job_status":"start","queue_duration_s":2.493809,"scheduling_latency_s":2.493825}1486gitlab # [ 243.056668] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.416Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"bc8eda3d49e81a8213ee2679","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-bc8eda3d49e81a8213ee2679: done: 0.0201 sec","job_status":"done","queue_duration_s":2.493809,"scheduling_latency_s":2.493825,"redis_calls":10,"redis_duration_s":0.002437,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001014,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001423,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012489,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.0201,"completed_at":"2026-08-15T09:33:03.416Z","load_balancing_strategy":"primary","db_duration_s":0.001245,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1487gitlab # [ 243.106596] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.418Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"4e05640a2a048b5d422c5ac2","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-4e05640a2a048b5d422c5ac2: start","job_status":"start","queue_duration_s":2.515392,"scheduling_latency_s":2.515409}1488gitlab # [ 243.120262] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.438Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"4e05640a2a048b5d422c5ac2","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-4e05640a2a048b5d422c5ac2: done: 0.019805 sec","job_status":"done","queue_duration_s":2.515392,"scheduling_latency_s":2.515409,"redis_calls":10,"redis_duration_s":0.0028510000000000002,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001795,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013389,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019805,"completed_at":"2026-08-15T09:33:03.438Z","load_balancing_strategy":"primary","db_duration_s":0.001363,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1489gitlab # [ 243.159990] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.439Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"57e9bd6215f7dcc27d6235b7","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-57e9bd6215f7dcc27d6235b7: start","job_status":"start","queue_duration_s":2.536552,"scheduling_latency_s":2.536567}1490gitlab # [ 243.171913] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.458Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"57e9bd6215f7dcc27d6235b7","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-57e9bd6215f7dcc27d6235b7: done: 0.018744 sec","job_status":"done","queue_duration_s":2.536552,"scheduling_latency_s":2.536567,"redis_calls":10,"redis_duration_s":0.0023179999999999997,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000954,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001364,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01291,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018744,"completed_at":"2026-08-15T09:33:03.458Z","load_balancing_strategy":"primary","db_duration_s":0.00123,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1491gitlab # [ 243.210807] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.459Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"44d4b8436ad73a60500a4902","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-44d4b8436ad73a60500a4902: start","job_status":"start","queue_duration_s":2.556642,"scheduling_latency_s":2.556658}1492gitlab # [ 243.223312] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.479Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"44d4b8436ad73a60500a4902","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-44d4b8436ad73a60500a4902: done: 0.020078 sec","job_status":"done","queue_duration_s":2.556642,"scheduling_latency_s":2.556658,"redis_calls":10,"redis_duration_s":0.0033179999999999998,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001797,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001521,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013321,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020078,"completed_at":"2026-08-15T09:33:03.479Z","load_balancing_strategy":"primary","db_duration_s":0.001303,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1493gitlab # [ 243.264257] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.481Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e22bae33e683de3a7db096a6","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e22bae33e683de3a7db096a6: start","job_status":"start","queue_duration_s":2.578097,"scheduling_latency_s":2.578112}1494gitlab # [ 243.277239] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:03.499Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e22bae33e683de3a7db096a6","created_at":"2026-08-15T09:33:00.823Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-8646d40c9232449a","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"358ca90575ecd719a1f2253e7717663b","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:00.902Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e22bae33e683de3a7db096a6: done: 0.018573 sec","job_status":"done","queue_duration_s":2.578097,"scheduling_latency_s":2.578112,"redis_calls":10,"redis_duration_s":0.002266,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000931,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001335,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012816,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018573,"completed_at":"2026-08-15T09:33:03.499Z","load_balancing_strategy":"primary","db_duration_s":0.001214,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1495gitlab # [ 243.318842] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:06.845Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"33a89df1a6687cca67b40f80","created_at":"2026-08-15T09:33:06.835Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"206164f836f06526213f7841b5477623","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-15T09:33:06.844Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-33a89df1a6687cca67b40f80: start","job_status":"start","queue_duration_s":0.001369,"scheduling_latency_s":0.00141}1496gitlab # [ 243.333747] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:06.895Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"33a89df1a6687cca67b40f80","created_at":"2026-08-15T09:33:06.835Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"206164f836f06526213f7841b5477623","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-15T09:33:06.844Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-33a89df1a6687cca67b40f80: done: 0.050308 sec","job_status":"done","queue_duration_s":0.001369,"scheduling_latency_s":0.00141,"redis_calls":10,"redis_duration_s":0.011337,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007053,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.004284,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019335,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01208744,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.050308,"completed_at":"2026-08-15T09:33:06.895Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00831,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1497gitlab # [ 243.376295] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:06.897Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"4f53fc79f2aa2ed613870da8","created_at":"2026-08-15T09:33:06.854Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-15T09:33:06.862Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-4f53fc79f2aa2ed613870da8: start","job_status":"start","queue_duration_s":0.035476,"scheduling_latency_s":0.035492}1498gitlab # [ 243.465353] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:07.304Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"4f53fc79f2aa2ed613870da8","created_at":"2026-08-15T09:33:06.854Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-15T09:33:06.862Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-4f53fc79f2aa2ed613870da8: done: 0.406606 sec","job_status":"done","queue_duration_s":0.035476,"scheduling_latency_s":0.035492,"redis_calls":60,"redis_duration_s":0.157476,"redis_read_bytes":108,"redis_write_bytes":41109,"redis_queues_calls":2,"redis_queues_duration_s":0.000748,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.146407,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.010321,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.120849,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.406606,"completed_at":"2026-08-15T09:33:07.304Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1499gitlab # [ 243.556069] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:07.306Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"d5bae559ee8cb90fba820897","created_at":"2026-08-15T09:33:06.879Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"72c06c85615125c4617a6cfc4639cf93","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-15T09:33:06.883Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-d5bae559ee8cb90fba820897: start","job_status":"start","queue_duration_s":0.423107,"scheduling_latency_s":0.423134}1500gitlab # [ 243.573050] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:07.346Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"d5bae559ee8cb90fba820897","created_at":"2026-08-15T09:33:06.879Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"72c06c85615125c4617a6cfc4639cf93","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-15T09:33:06.883Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-d5bae559ee8cb90fba820897: done: 0.039827 sec","job_status":"done","queue_duration_s":0.423107,"scheduling_latency_s":0.423134,"redis_calls":7,"redis_duration_s":0.001923,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001554,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000369,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013439,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.039827,"completed_at":"2026-08-15T09:33:07.346Z","load_balancing_strategy":"primary","db_duration_s":0.004012,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1501gitlab # [ 243.614997] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:07.347Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"39f623e591d94487c406b2f4","created_at":"2026-08-15T09:33:06.890Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"910b622091cf893e5879bd757cc2758a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-15T09:33:06.892Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-39f623e591d94487c406b2f4: start","job_status":"start","queue_duration_s":0.455031,"scheduling_latency_s":0.455056}1502gitlab # [ 243.629351] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:07.358Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1503gitlab # [ 243.632656] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:07.365Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"39f623e591d94487c406b2f4","created_at":"2026-08-15T09:33:06.890Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"910b622091cf893e5879bd757cc2758a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-15T09:33:06.892Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-39f623e591d94487c406b2f4: done: 0.017763 sec","job_status":"done","queue_duration_s":0.455031,"scheduling_latency_s":0.455056,"redis_calls":7,"redis_duration_s":0.0012900000000000001,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00093,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00036,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011081,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017763,"completed_at":"2026-08-15T09:33:07.365Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1504gitlab # [ 243.673995] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:07.366Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"4cfe75f03c6600ec248587a9","created_at":"2026-08-15T09:33:06.905Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"544a8c593a5585cc9128f8ba6ec6d560","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-15T09:33:06.908Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-4cfe75f03c6600ec248587a9: start","job_status":"start","queue_duration_s":0.457937,"scheduling_latency_s":0.457959}1505gitlab # [ 243.819861] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:07.658Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"4cfe75f03c6600ec248587a9","created_at":"2026-08-15T09:33:06.905Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"544a8c593a5585cc9128f8ba6ec6d560","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-15T09:33:06.908Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-4cfe75f03c6600ec248587a9: done: 0.292021 sec","job_status":"done","queue_duration_s":0.457937,"scheduling_latency_s":0.457959,"redis_calls":562,"redis_duration_s":0.051999000000000004,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000812,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.051187,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.273478,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.292021,"completed_at":"2026-08-15T09:33:07.658Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1506gitlab # [ 243.861245] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:07.661Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"ca71a8b7ee719f7f884edd23","created_at":"2026-08-15T09:33:06.926Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c1d379505f16c28b2c4652705acebe7b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-15T09:33:06.930Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-ca71a8b7ee719f7f884edd23: start","job_status":"start","queue_duration_s":0.730547,"scheduling_latency_s":0.730577}1507gitlab # [ 243.919630] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:07.758Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"ca71a8b7ee719f7f884edd23","created_at":"2026-08-15T09:33:06.926Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c1d379505f16c28b2c4652705acebe7b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-15T09:33:06.930Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-ca71a8b7ee719f7f884edd23: done: 0.097285 sec","job_status":"done","queue_duration_s":0.730547,"scheduling_latency_s":0.730577,"redis_calls":9,"redis_duration_s":0.0029969999999999997,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001553,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001444,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.034,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.034,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032557,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00064942,"exclusive_lock_hold_duration_s":0.07647632,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.097285,"completed_at":"2026-08-15T09:33:07.758Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.066294,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1508gitlab # [ 243.976125] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:07.761Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"e0b47a0172652f23b9b6090f","created_at":"2026-08-15T09:33:06.940Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8201ced82e533575b145fa073cc3c98e","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-15T09:33:06.943Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-e0b47a0172652f23b9b6090f: start","job_status":"start","queue_duration_s":0.817741,"scheduling_latency_s":0.817778}1509gitlab # [ 244.017672] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:07.784Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"e0b47a0172652f23b9b6090f","created_at":"2026-08-15T09:33:06.940Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8201ced82e533575b145fa073cc3c98e","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-15T09:33:06.943Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-e0b47a0172652f23b9b6090f: done: 0.023486 sec","job_status":"done","queue_duration_s":0.817741,"scheduling_latency_s":0.817778,"redis_calls":7,"redis_duration_s":0.002094,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001521,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000573,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014285,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023486,"completed_at":"2026-08-15T09:33:07.784Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001447,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1510gitlab # [ 244.087270] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:07.786Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"4740fd96cf45848c53afe053","created_at":"2026-08-15T09:33:06.955Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3bc9a6a36a90553f29c1d67ce13752fa","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-15T09:33:06.962Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-4740fd96cf45848c53afe053: start","job_status":"start","queue_duration_s":0.824677,"scheduling_latency_s":0.824707}1511gitlab # [ 244.127772] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:07.804Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"4740fd96cf45848c53afe053","created_at":"2026-08-15T09:33:06.955Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3bc9a6a36a90553f29c1d67ce13752fa","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-15T09:33:06.962Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-4740fd96cf45848c53afe053: done: 0.017204 sec","job_status":"done","queue_duration_s":0.824677,"scheduling_latency_s":0.824707,"redis_calls":7,"redis_duration_s":0.0018670000000000002,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001296,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000571,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010248,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017204,"completed_at":"2026-08-15T09:33:07.804Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1512gitlab # [ 244.188896] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:07.805Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"b15e897c71da646a686be937","created_at":"2026-08-15T09:33:06.974Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a2211420d47cf1f2bac13baba2faaa39","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-08-15T09:33:06.991Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-b15e897c71da646a686be937: start","job_status":"start","queue_duration_s":0.81391,"scheduling_latency_s":0.813934}1513gitlab # [ 244.204660] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:07.859Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"b15e897c71da646a686be937","created_at":"2026-08-15T09:33:06.974Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a2211420d47cf1f2bac13baba2faaa39","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-08-15T09:33:06.991Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-b15e897c71da646a686be937: done: 0.053667 sec","job_status":"done","queue_duration_s":0.81391,"scheduling_latency_s":0.813934,"redis_calls":28,"redis_duration_s":0.005718,"redis_read_bytes":36,"redis_write_bytes":10583,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000885,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":680,"redis_queues_calls":2,"redis_queues_duration_s":0.000429,"redis_queues_read_bytes":3,"redis_queues_write_bytes":8295,"redis_queues_metadata_calls":16,"redis_queues_metadata_duration_s":0.003146,"redis_queues_metadata_read_bytes":24,"redis_queues_metadata_write_bytes":1162,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001258,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":446,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040223,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00030884,"duration_s":0.053667,"completed_at":"2026-08-15T09:33:07.859Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00409,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1514gitlab # [ 244.248835] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:07.860Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"8e0e7d222da6ecff835e1a52","created_at":"2026-08-15T09:33:06.998Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"961f9dabab9239f1ca2d4dd860dd5c96","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.004Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-8e0e7d222da6ecff835e1a52: start","job_status":"start","queue_duration_s":0.856417,"scheduling_latency_s":0.856438}1515gitlab # [ 244.263715] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:07.868Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1516gitlab # [ 244.268668] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:07.874Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"8e0e7d222da6ecff835e1a52","created_at":"2026-08-15T09:33:06.998Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"961f9dabab9239f1ca2d4dd860dd5c96","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.004Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-8e0e7d222da6ecff835e1a52: done: 0.013478 sec","job_status":"done","queue_duration_s":0.856417,"scheduling_latency_s":0.856438,"redis_calls":7,"redis_duration_s":0.001671,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001205,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000466,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007927,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013478,"completed_at":"2026-08-15T09:33:07.874Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1517gitlab # [ 244.309386] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:07.875Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"f434f4e8c9c7cd3c47988b6a","created_at":"2026-08-15T09:33:07.047Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"69da4a2d30a2075870990c11c98c65a5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.053Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-f434f4e8c9c7cd3c47988b6a: start","job_status":"start","queue_duration_s":0.822402,"scheduling_latency_s":0.822421}1518gitlab # [ 244.324141] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:07.922Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"f434f4e8c9c7cd3c47988b6a","created_at":"2026-08-15T09:33:07.047Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"69da4a2d30a2075870990c11c98c65a5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.053Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-f434f4e8c9c7cd3c47988b6a: done: 0.046573 sec","job_status":"done","queue_duration_s":0.822402,"scheduling_latency_s":0.822421,"redis_calls":9,"redis_duration_s":0.0024860000000000004,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001195,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001291,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018488,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0007736,"exclusive_lock_hold_duration_s":0.01464932,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.046573,"completed_at":"2026-08-15T09:33:07.922Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.023513,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1519gitlab # [ 244.367130] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:07.924Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"4b2e72dfa5abda1ebc307e8b","created_at":"2026-08-15T09:33:07.060Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"abf4ad84fd7e72e8412364e111887639","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-15T09:33:07.073Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-4b2e72dfa5abda1ebc307e8b: start","job_status":"start","queue_duration_s":0.85112,"scheduling_latency_s":0.851138}1520gitlab # [ 244.380179] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:07.943Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"4b2e72dfa5abda1ebc307e8b","created_at":"2026-08-15T09:33:07.060Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"abf4ad84fd7e72e8412364e111887639","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-15T09:33:07.073Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-4b2e72dfa5abda1ebc307e8b: done: 0.019756 sec","job_status":"done","queue_duration_s":0.85112,"scheduling_latency_s":0.851138,"redis_calls":7,"redis_duration_s":0.001041,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000747,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000294,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014028,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019756,"completed_at":"2026-08-15T09:33:07.943Z","load_balancing_strategy":"primary","db_duration_s":0.001246,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1521gitlab # [ 244.419207] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:07.944Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"26eb618f9849c88ec1ec539c","created_at":"2026-08-15T09:33:07.096Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f34429884dfb7e7824eba269138fb8ce","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.100Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-26eb618f9849c88ec1ec539c: start","job_status":"start","queue_duration_s":0.844014,"scheduling_latency_s":0.844031}1522gitlab # [ 244.433244] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:07.961Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"26eb618f9849c88ec1ec539c","created_at":"2026-08-15T09:33:07.096Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f34429884dfb7e7824eba269138fb8ce","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.100Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-26eb618f9849c88ec1ec539c: done: 0.016305 sec","job_status":"done","queue_duration_s":0.844014,"scheduling_latency_s":0.844031,"redis_calls":9,"redis_duration_s":0.0013449999999999998,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000694,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000651,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010856,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00046036,"exclusive_lock_hold_duration_s":0.0032596,"duration_s":0.016305,"completed_at":"2026-08-15T09:33:07.961Z","load_balancing_strategy":"primary","db_duration_s":0.001071,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1523gitlab # [ 244.476331] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:07.962Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PipelineScheduleWorker","jid":"ba1af75d1efe00799298ac2c","created_at":"2026-08-15T09:33:07.119Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ab4a89501d65306eb0d1bb498481986e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f6baa6e6d21754c4b13358fe49f8c31a08729a9dd276fb680a810caf1bc7fab5","size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.130Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineScheduleWorker JID-ba1af75d1efe00799298ac2c: start","job_status":"start","queue_duration_s":0.831933,"scheduling_latency_s":0.83195}1524gitlab # [ 244.489544] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:07.995Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PipelineScheduleWorker","jid":"ba1af75d1efe00799298ac2c","created_at":"2026-08-15T09:33:07.119Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ab4a89501d65306eb0d1bb498481986e","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f6baa6e6d21754c4b13358fe49f8c31a08729a9dd276fb680a810caf1bc7fab5","size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.130Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineScheduleWorker JID-ba1af75d1efe00799298ac2c: done: 0.033455 sec","job_status":"done","queue_duration_s":0.831933,"scheduling_latency_s":0.83195,"redis_calls":12,"redis_duration_s":0.001627,"redis_read_bytes":11,"redis_write_bytes":1281,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000278,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000728,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":518,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000621,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":476,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017715,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0004679,"exclusive_lock_hold_duration_s":0.0157059,"duration_s":0.033455,"completed_at":"2026-08-15T09:33:07.995Z","load_balancing_strategy":"primary","db_duration_s":0.009371,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1525gitlab # [ 244.530396] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:07.996Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"a0c1e78c8faf86ee297e4b72","created_at":"2026-08-15T09:33:07.139Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"faafc808f7093eb82aca5ad889464dd5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.142Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-a0c1e78c8faf86ee297e4b72: start","job_status":"start","queue_duration_s":0.854428,"scheduling_latency_s":0.854445}1526gitlab # [ 244.543739] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.020Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"a0c1e78c8faf86ee297e4b72","created_at":"2026-08-15T09:33:07.139Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"faafc808f7093eb82aca5ad889464dd5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.142Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-a0c1e78c8faf86ee297e4b72: done: 0.024003 sec","job_status":"done","queue_duration_s":0.854428,"scheduling_latency_s":0.854445,"redis_calls":14,"redis_duration_s":0.001882,"redis_read_bytes":16,"redis_write_bytes":4026,"redis_queues_calls":2,"redis_queues_duration_s":0.000212,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.00124,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00043,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018442,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024003,"completed_at":"2026-08-15T09:33:08.020Z","load_balancing_strategy":"primary","db_duration_s":0.000916,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1527gitlab # [ 244.585005] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.022Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"a3b68a8af6c585a727180015","created_at":"2026-08-15T09:33:07.167Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ea58b12caa7a9ff9bcae94128815b2ee","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-15T09:33:07.175Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-a3b68a8af6c585a727180015: start","job_status":"start","queue_duration_s":0.846404,"scheduling_latency_s":0.846421}1528gitlab # [ 244.598433] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.029Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1529gitlab # [ 244.602223] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.034Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"a3b68a8af6c585a727180015","created_at":"2026-08-15T09:33:07.167Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ea58b12caa7a9ff9bcae94128815b2ee","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-15T09:33:07.175Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-a3b68a8af6c585a727180015: done: 0.012214 sec","job_status":"done","queue_duration_s":0.846404,"scheduling_latency_s":0.846421,"redis_calls":7,"redis_duration_s":0.000945,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000682,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000263,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007856,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012214,"completed_at":"2026-08-15T09:33:08.034Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1530gitlab # [ 244.641646] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.035Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"556f79db74e8f808ee157b35","created_at":"2026-08-15T09:33:07.214Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3eaa68b03f7e0635754a91412870c35e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.218Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-556f79db74e8f808ee157b35: start","job_status":"start","queue_duration_s":0.817332,"scheduling_latency_s":0.817349}1531gitlab # [ 244.655832] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.280Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"556f79db74e8f808ee157b35","created_at":"2026-08-15T09:33:07.214Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3eaa68b03f7e0635754a91412870c35e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.218Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-556f79db74e8f808ee157b35: done: 0.244616 sec","job_status":"done","queue_duration_s":0.817332,"scheduling_latency_s":0.817349,"redis_calls":9,"redis_duration_s":0.001363,"redis_read_bytes":7,"redis_write_bytes":987,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000698,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000665,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":129,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":129,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.04,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.04,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.194037,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00051258,"exclusive_lock_hold_duration_s":0.23047982,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.244616,"completed_at":"2026-08-15T09:33:08.280Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.060563,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1532gitlab # [ 244.700046] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.281Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"b5577abb2b18ce67a848e992","created_at":"2026-08-15T09:33:07.225Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"50bf56fb4d9116ffa216a67d2ea92728","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.232Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-b5577abb2b18ce67a848e992: start","job_status":"start","queue_duration_s":1.049311,"scheduling_latency_s":1.049328}1533gitlab # [ 244.714237] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.298Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"b5577abb2b18ce67a848e992","created_at":"2026-08-15T09:33:07.225Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"50bf56fb4d9116ffa216a67d2ea92728","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.232Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-b5577abb2b18ce67a848e992: done: 0.016719 sec","job_status":"done","queue_duration_s":1.049311,"scheduling_latency_s":1.049328,"redis_calls":9,"redis_duration_s":0.0014199999999999998,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000744,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000676,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011047,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00049952,"exclusive_lock_hold_duration_s":0.00261658,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.016719,"completed_at":"2026-08-15T09:33:08.298Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000987,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1534gitlab # [ 244.756333] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.299Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"b99a175262c8866ddf409f8b","created_at":"2026-08-15T09:33:07.237Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f4d41af5c981f9283137aecd6397892b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.241Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-b99a175262c8866ddf409f8b: start","job_status":"start","queue_duration_s":1.058358,"scheduling_latency_s":1.058375}1535gitlab # [ 244.770738] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.307Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1536gitlab # [ 244.774491] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.312Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"b99a175262c8866ddf409f8b","created_at":"2026-08-15T09:33:07.237Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f4d41af5c981f9283137aecd6397892b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.241Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-b99a175262c8866ddf409f8b: done: 0.013038 sec","job_status":"done","queue_duration_s":1.058358,"scheduling_latency_s":1.058375,"redis_calls":7,"redis_duration_s":0.000982,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000703,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000279,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008335,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013038,"completed_at":"2026-08-15T09:33:08.312Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1537gitlab # [ 244.815413] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.313Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"e897037c11cdee7d4854fd32","created_at":"2026-08-15T09:33:07.258Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8a8108730feec3fb0e7453be5610a6c4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-15T09:33:07.262Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-e897037c11cdee7d4854fd32: start","job_status":"start","queue_duration_s":1.051563,"scheduling_latency_s":1.05158}1538gitlab # [ 244.828788] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.321Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1539gitlab # [ 244.832001] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.326Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"e897037c11cdee7d4854fd32","created_at":"2026-08-15T09:33:07.258Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8a8108730feec3fb0e7453be5610a6c4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-15T09:33:07.262Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-e897037c11cdee7d4854fd32: done: 0.013001 sec","job_status":"done","queue_duration_s":1.051563,"scheduling_latency_s":1.05158,"redis_calls":7,"redis_duration_s":0.000973,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000705,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000268,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00854,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013001,"completed_at":"2026-08-15T09:33:08.326Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1540gitlab # [ 244.871725] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.328Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"78dbc54e96e3d2cc8283289e","created_at":"2026-08-15T09:33:07.272Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b072b2c4aacb494eda389f635d4b000b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.277Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-78dbc54e96e3d2cc8283289e: start","job_status":"start","queue_duration_s":1.050847,"scheduling_latency_s":1.050863}1541gitlab # [ 244.887332] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.412Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1542gitlab # [ 244.890698] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.419Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"78dbc54e96e3d2cc8283289e","created_at":"2026-08-15T09:33:07.272Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b072b2c4aacb494eda389f635d4b000b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.277Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-78dbc54e96e3d2cc8283289e: done: 0.090889 sec","job_status":"done","queue_duration_s":1.050847,"scheduling_latency_s":1.050863,"redis_calls":7,"redis_duration_s":0.001077,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000763,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000314,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.085829,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.090889,"completed_at":"2026-08-15T09:33:08.418Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1543gitlab # [ 244.931512] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.420Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27955615586cfd031c2563f1","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27955615586cfd031c2563f1: start","job_status":"start","queue_duration_s":1.139926,"scheduling_latency_s":1.139943}1544gitlab # [ 244.944214] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.434Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27955615586cfd031c2563f1","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27955615586cfd031c2563f1: done: 0.014427 sec","job_status":"done","queue_duration_s":1.139926,"scheduling_latency_s":1.139943,"redis_calls":13,"redis_duration_s":0.001493,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000554,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000939,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009852,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014427,"completed_at":"2026-08-15T09:33:08.434Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1545gitlab # [ 244.983378] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.435Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f08bcfa026783a32b5e4bb6a","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f08bcfa026783a32b5e4bb6a: start","job_status":"start","queue_duration_s":1.155399,"scheduling_latency_s":1.155415}1546gitlab # [ 244.996057] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.450Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f08bcfa026783a32b5e4bb6a","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f08bcfa026783a32b5e4bb6a: done: 0.015167 sec","job_status":"done","queue_duration_s":1.155399,"scheduling_latency_s":1.155415,"redis_calls":13,"redis_duration_s":0.00231,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001789,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010734,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015167,"completed_at":"2026-08-15T09:33:08.450Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1547gitlab # [ 245.035590] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.451Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c77245348648228439d0bcdd","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c77245348648228439d0bcdd: start","job_status":"start","queue_duration_s":1.171662,"scheduling_latency_s":1.171678}1548gitlab # [ 245.048797] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.466Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c77245348648228439d0bcdd","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c77245348648228439d0bcdd: done: 0.014667 sec","job_status":"done","queue_duration_s":1.171662,"scheduling_latency_s":1.171678,"redis_calls":13,"redis_duration_s":0.001461,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000943,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010314,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014667,"completed_at":"2026-08-15T09:33:08.466Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1549gitlab # [ 245.090071] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.467Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77fab2d22b472b66abc8e0eb","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77fab2d22b472b66abc8e0eb: start","job_status":"start","queue_duration_s":1.187567,"scheduling_latency_s":1.187584}1550gitlab # [ 245.102195] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.482Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77fab2d22b472b66abc8e0eb","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77fab2d22b472b66abc8e0eb: done: 0.014617 sec","job_status":"done","queue_duration_s":1.187567,"scheduling_latency_s":1.187584,"redis_calls":13,"redis_duration_s":0.001395,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000882,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009484,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014617,"completed_at":"2026-08-15T09:33:08.482Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1551gitlab # [ 245.141112] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.484Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b422488ddc1b3e2a5066863","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b422488ddc1b3e2a5066863: start","job_status":"start","queue_duration_s":1.204216,"scheduling_latency_s":1.204233}1552gitlab # [ 245.153709] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.499Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b422488ddc1b3e2a5066863","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b422488ddc1b3e2a5066863: done: 0.015 sec","job_status":"done","queue_duration_s":1.204216,"scheduling_latency_s":1.204233,"redis_calls":13,"redis_duration_s":0.001444,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000901,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010522,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015,"completed_at":"2026-08-15T09:33:08.499Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1553gitlab # [ 245.194809] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.500Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb49118597987b1ab26f9983","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb49118597987b1ab26f9983: start","job_status":"start","queue_duration_s":1.220286,"scheduling_latency_s":1.220302}1554gitlab # [ 245.207276] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.515Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb49118597987b1ab26f9983","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb49118597987b1ab26f9983: done: 0.014823 sec","job_status":"done","queue_duration_s":1.220286,"scheduling_latency_s":1.220302,"redis_calls":13,"redis_duration_s":0.0014520000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000943,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01053,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014823,"completed_at":"2026-08-15T09:33:08.515Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1555gitlab # [ 245.246003] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.516Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91f824211fa22587e3547a9f","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91f824211fa22587e3547a9f: start","job_status":"start","queue_duration_s":1.236196,"scheduling_latency_s":1.236212}1556gitlab # [ 245.259279] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.531Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91f824211fa22587e3547a9f","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91f824211fa22587e3547a9f: done: 0.014965 sec","job_status":"done","queue_duration_s":1.236196,"scheduling_latency_s":1.236212,"redis_calls":13,"redis_duration_s":0.00152,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000547,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000973,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01067,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014965,"completed_at":"2026-08-15T09:33:08.531Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1557gitlab # [ 245.300205] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.532Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f532472a91f55f4d340bf1e4","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f532472a91f55f4d340bf1e4: start","job_status":"start","queue_duration_s":1.25227,"scheduling_latency_s":1.252285}1558gitlab # [ 245.312457] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.547Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f532472a91f55f4d340bf1e4","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f532472a91f55f4d340bf1e4: done: 0.014849 sec","job_status":"done","queue_duration_s":1.25227,"scheduling_latency_s":1.252285,"redis_calls":13,"redis_duration_s":0.001417,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000903,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009574,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014849,"completed_at":"2026-08-15T09:33:08.547Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1559gitlab # [ 245.352499] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.549Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ffd6278a767550ac5227158a","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ffd6278a767550ac5227158a: start","job_status":"start","queue_duration_s":1.269227,"scheduling_latency_s":1.269244}1560gitlab # [ 245.364752] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.564Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ffd6278a767550ac5227158a","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ffd6278a767550ac5227158a: done: 0.014639 sec","job_status":"done","queue_duration_s":1.269227,"scheduling_latency_s":1.269244,"redis_calls":13,"redis_duration_s":0.001415,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000911,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010192,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014639,"completed_at":"2026-08-15T09:33:08.563Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1561gitlab # [ 245.405917] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.565Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dcfcd2e6a43d84089fa18ebe","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dcfcd2e6a43d84089fa18ebe: start","job_status":"start","queue_duration_s":1.284912,"scheduling_latency_s":1.284928}1562gitlab # [ 245.418306] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.580Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dcfcd2e6a43d84089fa18ebe","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dcfcd2e6a43d84089fa18ebe: done: 0.0154 sec","job_status":"done","queue_duration_s":1.284912,"scheduling_latency_s":1.284928,"redis_calls":13,"redis_duration_s":0.001529,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001011,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010748,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0154,"completed_at":"2026-08-15T09:33:08.580Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1563gitlab # [ 245.458106] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.581Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff439ca731bb92ef59eb58e8","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff439ca731bb92ef59eb58e8: start","job_status":"start","queue_duration_s":1.301338,"scheduling_latency_s":1.301354}1564gitlab # [ 245.471649] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.598Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff439ca731bb92ef59eb58e8","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff439ca731bb92ef59eb58e8: done: 0.017025 sec","job_status":"done","queue_duration_s":1.301338,"scheduling_latency_s":1.301354,"redis_calls":13,"redis_duration_s":0.0015209999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000996,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010769,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017025,"completed_at":"2026-08-15T09:33:08.598Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1565gitlab # [ 245.512906] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.600Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c997eaaeac2cbb5903b151d4","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c997eaaeac2cbb5903b151d4: start","job_status":"start","queue_duration_s":1.320197,"scheduling_latency_s":1.320215}1566gitlab # [ 245.525466] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.615Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c997eaaeac2cbb5903b151d4","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c997eaaeac2cbb5903b151d4: done: 0.015227 sec","job_status":"done","queue_duration_s":1.320197,"scheduling_latency_s":1.320215,"redis_calls":13,"redis_duration_s":0.001526,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000545,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000981,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010541,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015227,"completed_at":"2026-08-15T09:33:08.615Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1567gitlab # [ 245.564837] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.616Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d30af159cf08edc07abfdcdb","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d30af159cf08edc07abfdcdb: start","job_status":"start","queue_duration_s":1.336502,"scheduling_latency_s":1.336518}1568gitlab # [ 245.577579] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.632Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d30af159cf08edc07abfdcdb","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d30af159cf08edc07abfdcdb: done: 0.015457 sec","job_status":"done","queue_duration_s":1.336502,"scheduling_latency_s":1.336518,"redis_calls":13,"redis_duration_s":0.0014550000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010889,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015457,"completed_at":"2026-08-15T09:33:08.632Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1569gitlab # [ 245.617448] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.633Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc642f5f3609b50c3e8f67e7","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc642f5f3609b50c3e8f67e7: start","job_status":"start","queue_duration_s":1.353034,"scheduling_latency_s":1.35305}1570gitlab # [ 245.630682] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.648Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc642f5f3609b50c3e8f67e7","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc642f5f3609b50c3e8f67e7: done: 0.015121 sec","job_status":"done","queue_duration_s":1.353034,"scheduling_latency_s":1.35305,"redis_calls":13,"redis_duration_s":0.001444,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000561,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000883,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010756,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015121,"completed_at":"2026-08-15T09:33:08.648Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1571gitlab # [ 245.670449] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.649Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e9af8f101d0b4aafcc385a8e","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e9af8f101d0b4aafcc385a8e: start","job_status":"start","queue_duration_s":1.369263,"scheduling_latency_s":1.369279}1572gitlab # [ 245.683042] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.664Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e9af8f101d0b4aafcc385a8e","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e9af8f101d0b4aafcc385a8e: done: 0.015009 sec","job_status":"done","queue_duration_s":1.369263,"scheduling_latency_s":1.369279,"redis_calls":13,"redis_duration_s":0.0014390000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000536,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000903,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009658,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015009,"completed_at":"2026-08-15T09:33:08.664Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1573gitlab # [ 245.723632] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.666Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"721dd060825196606941c5d7","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-721dd060825196606941c5d7: start","job_status":"start","queue_duration_s":1.386561,"scheduling_latency_s":1.386579}1574gitlab # [ 245.736049] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.682Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"721dd060825196606941c5d7","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-721dd060825196606941c5d7: done: 0.015672 sec","job_status":"done","queue_duration_s":1.386561,"scheduling_latency_s":1.386579,"redis_calls":13,"redis_duration_s":0.001443,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000915,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009639,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015672,"completed_at":"2026-08-15T09:33:08.682Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1575gitlab # [ 245.775403] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.683Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"712e854b9bdc8d6252e375d1","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-712e854b9bdc8d6252e375d1: start","job_status":"start","queue_duration_s":1.403326,"scheduling_latency_s":1.403342}1576gitlab # [ 245.787759] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.699Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"712e854b9bdc8d6252e375d1","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-712e854b9bdc8d6252e375d1: done: 0.015575 sec","job_status":"done","queue_duration_s":1.403326,"scheduling_latency_s":1.403342,"redis_calls":13,"redis_duration_s":0.001504,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000975,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010853,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015575,"completed_at":"2026-08-15T09:33:08.699Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1577gitlab # [ 245.827260] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.700Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"69e63cc204ffe59356601f85","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-69e63cc204ffe59356601f85: start","job_status":"start","queue_duration_s":1.420019,"scheduling_latency_s":1.420035}1578gitlab # [ 245.840074] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.715Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"69e63cc204ffe59356601f85","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-69e63cc204ffe59356601f85: done: 0.015209 sec","job_status":"done","queue_duration_s":1.420019,"scheduling_latency_s":1.420035,"redis_calls":13,"redis_duration_s":0.00145,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00089,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010847,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015209,"completed_at":"2026-08-15T09:33:08.715Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1579gitlab # [ 245.879226] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.716Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d2d97ef3f0c146d67b1e5fd","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d2d97ef3f0c146d67b1e5fd: start","job_status":"start","queue_duration_s":1.436305,"scheduling_latency_s":1.436321}1580gitlab # [ 245.891666] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.731Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d2d97ef3f0c146d67b1e5fd","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d2d97ef3f0c146d67b1e5fd: done: 0.014873 sec","job_status":"done","queue_duration_s":1.436305,"scheduling_latency_s":1.436321,"redis_calls":13,"redis_duration_s":0.001426,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000922,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009557,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014873,"completed_at":"2026-08-15T09:33:08.731Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1581gitlab # [ 245.932281] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.733Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"512b935a3b6fdae284af524a","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-512b935a3b6fdae284af524a: start","job_status":"start","queue_duration_s":1.453448,"scheduling_latency_s":1.453465}1582gitlab # [ 245.944505] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.748Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"512b935a3b6fdae284af524a","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-512b935a3b6fdae284af524a: done: 0.015234 sec","job_status":"done","queue_duration_s":1.453448,"scheduling_latency_s":1.453465,"redis_calls":13,"redis_duration_s":0.001457,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000941,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010767,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015234,"completed_at":"2026-08-15T09:33:08.748Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1583gitlab # [ 245.983632] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.750Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27cd31557a050fab504d33d7","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27cd31557a050fab504d33d7: start","job_status":"start","queue_duration_s":1.469879,"scheduling_latency_s":1.469896}1584gitlab # [ 245.996414] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.765Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27cd31557a050fab504d33d7","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27cd31557a050fab504d33d7: done: 0.015382 sec","job_status":"done","queue_duration_s":1.469879,"scheduling_latency_s":1.469896,"redis_calls":13,"redis_duration_s":0.00148,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000934,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010993,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015382,"completed_at":"2026-08-15T09:33:08.765Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1585gitlab # [ 246.035655] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.766Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a49ed754bfe09da2a7b8e642","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a49ed754bfe09da2a7b8e642: start","job_status":"start","queue_duration_s":1.486333,"scheduling_latency_s":1.486349}1586gitlab # [ 246.048297] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.782Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a49ed754bfe09da2a7b8e642","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a49ed754bfe09da2a7b8e642: done: 0.015854 sec","job_status":"done","queue_duration_s":1.486333,"scheduling_latency_s":1.486349,"redis_calls":13,"redis_duration_s":0.0015110000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000573,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000938,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010061,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015854,"completed_at":"2026-08-15T09:33:08.782Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1587gitlab # [ 246.087589] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.785Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"87c37b698049440e14843e83","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-87c37b698049440e14843e83: start","job_status":"start","queue_duration_s":1.504797,"scheduling_latency_s":1.504816}1588gitlab # [ 246.099960] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.800Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"87c37b698049440e14843e83","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-87c37b698049440e14843e83: done: 0.016163 sec","job_status":"done","queue_duration_s":1.504797,"scheduling_latency_s":1.504816,"redis_calls":13,"redis_duration_s":0.0014910000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000558,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000933,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01106,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016163,"completed_at":"2026-08-15T09:33:08.800Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1589gitlab # [ 246.140581] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.802Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f908dbc2e060a8339b0e2836","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f908dbc2e060a8339b0e2836: start","job_status":"start","queue_duration_s":1.521881,"scheduling_latency_s":1.521897}1590gitlab # [ 246.153288] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.817Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f908dbc2e060a8339b0e2836","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f908dbc2e060a8339b0e2836: done: 0.015791 sec","job_status":"done","queue_duration_s":1.521881,"scheduling_latency_s":1.521897,"redis_calls":13,"redis_duration_s":0.002529,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002025,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01142,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015791,"completed_at":"2026-08-15T09:33:08.817Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1591gitlab # [ 246.192273] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.818Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0b4461784d80d5df508613c0","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0b4461784d80d5df508613c0: start","job_status":"start","queue_duration_s":1.538742,"scheduling_latency_s":1.538758}1592gitlab # [ 246.204617] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.834Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0b4461784d80d5df508613c0","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0b4461784d80d5df508613c0: done: 0.01538 sec","job_status":"done","queue_duration_s":1.538742,"scheduling_latency_s":1.538758,"redis_calls":13,"redis_duration_s":0.001487,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000571,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010994,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01538,"completed_at":"2026-08-15T09:33:08.834Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1593gitlab # [ 246.243835] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.835Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ccc3cc4593b4cc149792fde","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ccc3cc4593b4cc149792fde: start","job_status":"start","queue_duration_s":1.555187,"scheduling_latency_s":1.555202}1594gitlab # [ 246.257248] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.851Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ccc3cc4593b4cc149792fde","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ccc3cc4593b4cc149792fde: done: 0.01618 sec","job_status":"done","queue_duration_s":1.555187,"scheduling_latency_s":1.555202,"redis_calls":13,"redis_duration_s":0.001386,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000871,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009688,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01618,"completed_at":"2026-08-15T09:33:08.851Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1595gitlab # [ 246.297134] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.852Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"46ed59d4c62346eb34274d2f","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-46ed59d4c62346eb34274d2f: start","job_status":"start","queue_duration_s":1.572507,"scheduling_latency_s":1.572522}1596gitlab # [ 246.310359] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.867Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"46ed59d4c62346eb34274d2f","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-46ed59d4c62346eb34274d2f: done: 0.014898 sec","job_status":"done","queue_duration_s":1.572507,"scheduling_latency_s":1.572522,"redis_calls":13,"redis_duration_s":0.001426,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000915,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010644,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014898,"completed_at":"2026-08-15T09:33:08.867Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1597gitlab # [ 246.349005] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.868Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"34bb5fad31565ab87a16314f","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-34bb5fad31565ab87a16314f: start","job_status":"start","queue_duration_s":1.588547,"scheduling_latency_s":1.588563}1598gitlab # [ 246.361008] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.884Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"34bb5fad31565ab87a16314f","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-34bb5fad31565ab87a16314f: done: 0.015367 sec","job_status":"done","queue_duration_s":1.588547,"scheduling_latency_s":1.588563,"redis_calls":13,"redis_duration_s":0.001547,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000647,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0009,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010594,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015367,"completed_at":"2026-08-15T09:33:08.884Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1599gitlab # [ 246.402665] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.885Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d03def0c590edee6ce4703b4","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d03def0c590edee6ce4703b4: start","job_status":"start","queue_duration_s":1.605037,"scheduling_latency_s":1.605053}1600gitlab # [ 246.415138] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.900Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d03def0c590edee6ce4703b4","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d03def0c590edee6ce4703b4: done: 0.015479 sec","job_status":"done","queue_duration_s":1.605037,"scheduling_latency_s":1.605053,"redis_calls":13,"redis_duration_s":0.001522,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000556,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000966,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010064,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015479,"completed_at":"2026-08-15T09:33:08.900Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1601gitlab # [ 246.454797] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.902Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e3ec8446b3ebfac861d0898","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e3ec8446b3ebfac861d0898: start","job_status":"start","queue_duration_s":1.622445,"scheduling_latency_s":1.622462}1602gitlab # [ 246.468602] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.918Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e3ec8446b3ebfac861d0898","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e3ec8446b3ebfac861d0898: done: 0.015996 sec","job_status":"done","queue_duration_s":1.622445,"scheduling_latency_s":1.622462,"redis_calls":13,"redis_duration_s":0.001544,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000574,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00097,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011385,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015996,"completed_at":"2026-08-15T09:33:08.918Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1603gitlab # [ 246.512276] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.919Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0eac3bebf03cc510b5c0d20","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0eac3bebf03cc510b5c0d20: start","job_status":"start","queue_duration_s":1.639467,"scheduling_latency_s":1.639483}1604gitlab # [ 246.524555] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.934Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0eac3bebf03cc510b5c0d20","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0eac3bebf03cc510b5c0d20: done: 0.015073 sec","job_status":"done","queue_duration_s":1.639467,"scheduling_latency_s":1.639483,"redis_calls":13,"redis_duration_s":0.0014759999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000959,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010707,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015073,"completed_at":"2026-08-15T09:33:08.934Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1605gitlab # [ 246.563176] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.935Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2679ad5119777b7e20bc0e5","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2679ad5119777b7e20bc0e5: start","job_status":"start","queue_duration_s":1.655607,"scheduling_latency_s":1.655623}1606gitlab # [ 246.575617] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.950Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2679ad5119777b7e20bc0e5","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2679ad5119777b7e20bc0e5: done: 0.014996 sec","job_status":"done","queue_duration_s":1.655607,"scheduling_latency_s":1.655623,"redis_calls":13,"redis_duration_s":0.001426,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00091,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010657,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014996,"completed_at":"2026-08-15T09:33:08.950Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1607gitlab # [ 246.614591] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.951Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"df84c0a868971a173c2a6f93","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-df84c0a868971a173c2a6f93: start","job_status":"start","queue_duration_s":1.671715,"scheduling_latency_s":1.671732}1608gitlab # [ 246.626927] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.968Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"df84c0a868971a173c2a6f93","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-df84c0a868971a173c2a6f93: done: 0.016133 sec","job_status":"done","queue_duration_s":1.671715,"scheduling_latency_s":1.671732,"redis_calls":13,"redis_duration_s":0.001421,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000911,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01036,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016133,"completed_at":"2026-08-15T09:33:08.967Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1609gitlab # [ 246.665189] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.969Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b0abdc1a7d4e8d79535b843","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b0abdc1a7d4e8d79535b843: start","job_status":"start","queue_duration_s":1.688888,"scheduling_latency_s":1.688904}1610gitlab # [ 246.677401] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.984Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b0abdc1a7d4e8d79535b843","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b0abdc1a7d4e8d79535b843: done: 0.015115 sec","job_status":"done","queue_duration_s":1.688888,"scheduling_latency_s":1.688904,"redis_calls":13,"redis_duration_s":0.001488,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000959,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010461,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015115,"completed_at":"2026-08-15T09:33:08.984Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1611gitlab # [ 246.717020] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:08.985Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9880fd44b7440682d02ada27","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9880fd44b7440682d02ada27: start","job_status":"start","queue_duration_s":1.70505,"scheduling_latency_s":1.705065}1612gitlab # [ 246.729014] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.000Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9880fd44b7440682d02ada27","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9880fd44b7440682d02ada27: done: 0.014961 sec","job_status":"done","queue_duration_s":1.70505,"scheduling_latency_s":1.705065,"redis_calls":13,"redis_duration_s":0.001499,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000956,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010598,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014961,"completed_at":"2026-08-15T09:33:09.000Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1613gitlab # [ 246.767655] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.001Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"209a3d43626a25b08c7b1733","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-209a3d43626a25b08c7b1733: start","job_status":"start","queue_duration_s":1.721045,"scheduling_latency_s":1.72106}1614gitlab # [ 246.780138] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.017Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"209a3d43626a25b08c7b1733","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-209a3d43626a25b08c7b1733: done: 0.015913 sec","job_status":"done","queue_duration_s":1.721045,"scheduling_latency_s":1.72106,"redis_calls":13,"redis_duration_s":0.0014810000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000926,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009706,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015913,"completed_at":"2026-08-15T09:33:09.017Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1615gitlab # [ 246.820939] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.018Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad80e4c1467574362f0f5fae","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad80e4c1467574362f0f5fae: start","job_status":"start","queue_duration_s":1.738091,"scheduling_latency_s":1.738108}1616gitlab # [ 246.833658] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.033Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad80e4c1467574362f0f5fae","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad80e4c1467574362f0f5fae: done: 0.015731 sec","job_status":"done","queue_duration_s":1.738091,"scheduling_latency_s":1.738108,"redis_calls":13,"redis_duration_s":0.0015049999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000569,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000936,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01073,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015731,"completed_at":"2026-08-15T09:33:09.033Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1617gitlab # [ 246.872884] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.035Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"756c322f3363e631b3a56de5","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-756c322f3363e631b3a56de5: start","job_status":"start","queue_duration_s":1.754856,"scheduling_latency_s":1.754872}1618gitlab # [ 246.884980] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.050Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"756c322f3363e631b3a56de5","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-756c322f3363e631b3a56de5: done: 0.015013 sec","job_status":"done","queue_duration_s":1.754856,"scheduling_latency_s":1.754872,"redis_calls":13,"redis_duration_s":0.001535,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000613,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000922,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010698,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015013,"completed_at":"2026-08-15T09:33:09.050Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1619gitlab # [ 246.925170] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.051Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77997f3fa46064f0b486bd24","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77997f3fa46064f0b486bd24: start","job_status":"start","queue_duration_s":1.7709,"scheduling_latency_s":1.770915}1620gitlab # [ 246.937469] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.065Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77997f3fa46064f0b486bd24","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77997f3fa46064f0b486bd24: done: 0.014576 sec","job_status":"done","queue_duration_s":1.7709,"scheduling_latency_s":1.770915,"redis_calls":13,"redis_duration_s":0.001401,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000896,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009443,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014576,"completed_at":"2026-08-15T09:33:09.065Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1621gitlab # [ 246.976284] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.067Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b9b93f90c898f0f1f5f213ea","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b9b93f90c898f0f1f5f213ea: start","job_status":"start","queue_duration_s":1.78754,"scheduling_latency_s":1.787558}1622gitlab # [ 246.988595] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.082Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b9b93f90c898f0f1f5f213ea","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b9b93f90c898f0f1f5f213ea: done: 0.015135 sec","job_status":"done","queue_duration_s":1.78754,"scheduling_latency_s":1.787558,"redis_calls":13,"redis_duration_s":0.002211,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001328,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000883,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010551,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015135,"completed_at":"2026-08-15T09:33:09.082Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1623gitlab # [ 247.027531] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.084Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b46eec79fe964ae48bab70d4","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b46eec79fe964ae48bab70d4: start","job_status":"start","queue_duration_s":1.803796,"scheduling_latency_s":1.803812}1624gitlab # [ 247.040174] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.099Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b46eec79fe964ae48bab70d4","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b46eec79fe964ae48bab70d4: done: 0.015195 sec","job_status":"done","queue_duration_s":1.803796,"scheduling_latency_s":1.803812,"redis_calls":13,"redis_duration_s":0.001515,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000965,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010754,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015195,"completed_at":"2026-08-15T09:33:09.099Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1625gitlab # [ 247.081073] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.100Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c7d85cd6b06ca8b5134919de","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c7d85cd6b06ca8b5134919de: start","job_status":"start","queue_duration_s":1.820079,"scheduling_latency_s":1.820096}1626gitlab # [ 247.093503] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.115Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c7d85cd6b06ca8b5134919de","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c7d85cd6b06ca8b5134919de: done: 0.015402 sec","job_status":"done","queue_duration_s":1.820079,"scheduling_latency_s":1.820096,"redis_calls":13,"redis_duration_s":0.0014299999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00091,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009526,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015402,"completed_at":"2026-08-15T09:33:09.115Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1627gitlab # [ 247.133598] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.116Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b88bc0d93a31b9d824dfa81","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b88bc0d93a31b9d824dfa81: start","job_status":"start","queue_duration_s":1.83667,"scheduling_latency_s":1.836686}1628gitlab # [ 247.145808] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.131Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b88bc0d93a31b9d824dfa81","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b88bc0d93a31b9d824dfa81: done: 0.015003 sec","job_status":"done","queue_duration_s":1.83667,"scheduling_latency_s":1.836686,"redis_calls":13,"redis_duration_s":0.001412,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000878,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010619,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015003,"completed_at":"2026-08-15T09:33:09.131Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1629gitlab # [ 247.184848] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.132Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fbe6a1c65e2951ddbdadbb50","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fbe6a1c65e2951ddbdadbb50: start","job_status":"start","queue_duration_s":1.852702,"scheduling_latency_s":1.852718}1630gitlab # [ 247.197247] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.147Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fbe6a1c65e2951ddbdadbb50","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fbe6a1c65e2951ddbdadbb50: done: 0.014522 sec","job_status":"done","queue_duration_s":1.852702,"scheduling_latency_s":1.852718,"redis_calls":13,"redis_duration_s":0.001424,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000915,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010297,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014522,"completed_at":"2026-08-15T09:33:09.147Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1631gitlab # [ 247.236167] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.148Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5084dbe5e0a496e81c742bfc","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5084dbe5e0a496e81c742bfc: start","job_status":"start","queue_duration_s":1.868353,"scheduling_latency_s":1.868369}1632gitlab # [ 247.248310] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.164Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5084dbe5e0a496e81c742bfc","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5084dbe5e0a496e81c742bfc: done: 0.015795 sec","job_status":"done","queue_duration_s":1.868353,"scheduling_latency_s":1.868369,"redis_calls":13,"redis_duration_s":0.001748,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00066,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001088,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010618,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015795,"completed_at":"2026-08-15T09:33:09.164Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1633gitlab # [ 247.287088] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.166Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91c8a67f1fc01b8b10a82c38","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91c8a67f1fc01b8b10a82c38: start","job_status":"start","queue_duration_s":1.886012,"scheduling_latency_s":1.886028}1634gitlab # [ 247.299643] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.181Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91c8a67f1fc01b8b10a82c38","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91c8a67f1fc01b8b10a82c38: done: 0.015584 sec","job_status":"done","queue_duration_s":1.886012,"scheduling_latency_s":1.886028,"redis_calls":13,"redis_duration_s":0.0018110000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000714,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001097,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010925,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015584,"completed_at":"2026-08-15T09:33:09.181Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1635gitlab # [ 247.339523] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.182Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"291f4e8acbc625f01b6b2026","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-291f4e8acbc625f01b6b2026: start","job_status":"start","queue_duration_s":1.902679,"scheduling_latency_s":1.902696}1636gitlab # [ 247.352100] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.198Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"291f4e8acbc625f01b6b2026","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-291f4e8acbc625f01b6b2026: done: 0.01517 sec","job_status":"done","queue_duration_s":1.902679,"scheduling_latency_s":1.902696,"redis_calls":13,"redis_duration_s":0.001595,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000601,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000994,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010736,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01517,"completed_at":"2026-08-15T09:33:09.197Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1637gitlab # [ 247.390801] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.199Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d831b3587af8e3878d026a5","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d831b3587af8e3878d026a5: start","job_status":"start","queue_duration_s":1.919053,"scheduling_latency_s":1.919071}1638gitlab # [ 247.403017] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.214Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d831b3587af8e3878d026a5","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d831b3587af8e3878d026a5: done: 0.014889 sec","job_status":"done","queue_duration_s":1.919053,"scheduling_latency_s":1.919071,"redis_calls":13,"redis_duration_s":0.0015999999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000624,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000976,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01042,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014889,"completed_at":"2026-08-15T09:33:09.214Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1639gitlab # [ 247.442277] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.215Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"140a14e9fb46dbe1a08caedc","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-140a14e9fb46dbe1a08caedc: start","job_status":"start","queue_duration_s":1.934957,"scheduling_latency_s":1.934974}1640gitlab # [ 247.454788] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.229Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"140a14e9fb46dbe1a08caedc","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-140a14e9fb46dbe1a08caedc: done: 0.014494 sec","job_status":"done","queue_duration_s":1.934957,"scheduling_latency_s":1.934974,"redis_calls":13,"redis_duration_s":0.0013909999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000886,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009469,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014494,"completed_at":"2026-08-15T09:33:09.229Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1641gitlab # [ 247.494076] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.231Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f019fd8539b4e5e731e72d8","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f019fd8539b4e5e731e72d8: start","job_status":"start","queue_duration_s":1.951158,"scheduling_latency_s":1.951173}1642gitlab # [ 247.506540] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.247Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f019fd8539b4e5e731e72d8","created_at":"2026-08-15T09:33:06.912Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-da8db582d0b34759","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0b131bf51e91adf3f1e71ea59d99d06b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.280Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f019fd8539b4e5e731e72d8: done: 0.0162 sec","job_status":"done","queue_duration_s":1.951158,"scheduling_latency_s":1.951173,"redis_calls":13,"redis_duration_s":0.001531,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000589,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000942,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011696,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0162,"completed_at":"2026-08-15T09:33:09.247Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1643gitlab # [ 247.547130] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.248Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"b002e5570ae96d54aa3dcd1d","created_at":"2026-08-15T09:33:07.295Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3d9d42b97feef14e1b24f9989dfc035e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.301Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-b002e5570ae96d54aa3dcd1d: start","job_status":"start","queue_duration_s":1.946779,"scheduling_latency_s":1.946795}1644gitlab # [ 247.562798] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.261Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"b002e5570ae96d54aa3dcd1d","created_at":"2026-08-15T09:33:07.295Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3d9d42b97feef14e1b24f9989dfc035e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.301Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-b002e5570ae96d54aa3dcd1d: done: 0.01259 sec","job_status":"done","queue_duration_s":1.946779,"scheduling_latency_s":1.946795,"redis_calls":7,"redis_duration_s":0.000985,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000696,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000289,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008297,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01259,"completed_at":"2026-08-15T09:33:09.261Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1645gitlab # [ 247.603286] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.262Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"549bd4086e420626d487b378","created_at":"2026-08-15T09:33:07.324Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dced3eef0a173fef42423260485b1b9b","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.327Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-549bd4086e420626d487b378: start","job_status":"start","queue_duration_s":1.934468,"scheduling_latency_s":1.934484}1646gitlab # [ 247.617292] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.294Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"549bd4086e420626d487b378","created_at":"2026-08-15T09:33:07.324Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dced3eef0a173fef42423260485b1b9b","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.327Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-549bd4086e420626d487b378: done: 0.032129 sec","job_status":"done","queue_duration_s":1.934468,"scheduling_latency_s":1.934484,"redis_calls":7,"redis_duration_s":0.001707,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001281,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000426,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013936,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032129,"completed_at":"2026-08-15T09:33:09.294Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009825,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1647gitlab # [ 247.657560] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.296Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"ef71c726f7b5023f98daa884","created_at":"2026-08-15T09:33:07.830Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-cb0a2b46c27a4110","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a2211420d47cf1f2bac13baba2faaa39","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-ef71c726f7b5023f98daa884: start","job_status":"start","queue_duration_s":1.444069,"scheduling_latency_s":1.444406}1648gitlab # [ 247.670926] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.390Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"ef71c726f7b5023f98daa884","created_at":"2026-08-15T09:33:07.830Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-cb0a2b46c27a4110","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a2211420d47cf1f2bac13baba2faaa39","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-ef71c726f7b5023f98daa884: done: 0.09443 sec","job_status":"done","queue_duration_s":1.444069,"scheduling_latency_s":1.444406,"redis_calls":16,"redis_duration_s":0.0034089999999999997,"redis_read_bytes":14,"redis_write_bytes":1526,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000299,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000772,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":423,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002338,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":802,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042997,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00030164,"duration_s":0.09443,"completed_at":"2026-08-15T09:33:09.390Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.040532,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1649gitlab # [ 247.712047] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.394Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"24c6b37705234eb6e95dcb63","created_at":"2026-08-15T09:33:07.830Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-cb0a2b46c27a4110","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a2211420d47cf1f2bac13baba2faaa39","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-24c6b37705234eb6e95dcb63: start","job_status":"start","queue_duration_s":1.542671,"scheduling_latency_s":1.542694}1650gitlab # [ 247.725156] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.430Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"24c6b37705234eb6e95dcb63","created_at":"2026-08-15T09:33:07.830Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-cb0a2b46c27a4110","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a2211420d47cf1f2bac13baba2faaa39","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-24c6b37705234eb6e95dcb63: done: 0.036585 sec","job_status":"done","queue_duration_s":1.542671,"scheduling_latency_s":1.542694,"redis_calls":13,"redis_duration_s":0.00265,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000706,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001944,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023259,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.036585,"completed_at":"2026-08-15T09:33:09.430Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004451,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1651gitlab # [ 247.765130] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.432Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"d6c6afec390c225a1d7bdc35","created_at":"2026-08-15T09:33:07.830Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-cb0a2b46c27a4110","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a2211420d47cf1f2bac13baba2faaa39","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-d6c6afec390c225a1d7bdc35: start","job_status":"start","queue_duration_s":1.580627,"scheduling_latency_s":1.580646}1652gitlab # [ 247.778232] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.450Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"d6c6afec390c225a1d7bdc35","created_at":"2026-08-15T09:33:07.830Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-cb0a2b46c27a4110","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a2211420d47cf1f2bac13baba2faaa39","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-d6c6afec390c225a1d7bdc35: done: 0.01871 sec","job_status":"done","queue_duration_s":1.580627,"scheduling_latency_s":1.580646,"redis_calls":13,"redis_duration_s":0.0016359999999999999,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000556,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00108,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01181,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01871,"completed_at":"2026-08-15T09:33:09.450Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002017,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1653gitlab # [ 247.817512] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.452Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"bd7b0b2d0a14f2055b3ad1f1","created_at":"2026-08-15T09:33:07.830Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-cb0a2b46c27a4110","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a2211420d47cf1f2bac13baba2faaa39","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-bd7b0b2d0a14f2055b3ad1f1: start","job_status":"start","queue_duration_s":1.600498,"scheduling_latency_s":1.600516}1654gitlab # [ 247.830557] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.469Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"bd7b0b2d0a14f2055b3ad1f1","created_at":"2026-08-15T09:33:07.830Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-cb0a2b46c27a4110","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a2211420d47cf1f2bac13baba2faaa39","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-bd7b0b2d0a14f2055b3ad1f1: done: 0.016981 sec","job_status":"done","queue_duration_s":1.600498,"scheduling_latency_s":1.600516,"redis_calls":13,"redis_duration_s":0.0016120000000000002,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000569,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001043,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010905,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016981,"completed_at":"2026-08-15T09:33:09.469Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001659,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1655gitlab # [ 247.869875] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.470Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"b73e376681b5cfde12c6d6e9","created_at":"2026-08-15T09:33:07.830Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-cb0a2b46c27a4110","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a2211420d47cf1f2bac13baba2faaa39","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-b73e376681b5cfde12c6d6e9: start","job_status":"start","queue_duration_s":1.618621,"scheduling_latency_s":1.618638}1656gitlab # [ 247.883391] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.486Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"b73e376681b5cfde12c6d6e9","created_at":"2026-08-15T09:33:07.830Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-cb0a2b46c27a4110","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a2211420d47cf1f2bac13baba2faaa39","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-b73e376681b5cfde12c6d6e9: done: 0.016634 sec","job_status":"done","queue_duration_s":1.618621,"scheduling_latency_s":1.618638,"redis_calls":13,"redis_duration_s":0.001554,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001026,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010559,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016634,"completed_at":"2026-08-15T09:33:09.486Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001614,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1657gitlab # [ 247.924785] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.487Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"eb0ba59c40006a8ed2ed352c","created_at":"2026-08-15T09:33:07.830Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-cb0a2b46c27a4110","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a2211420d47cf1f2bac13baba2faaa39","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-eb0ba59c40006a8ed2ed352c: start","job_status":"start","queue_duration_s":1.636325,"scheduling_latency_s":1.636342}1658gitlab # [ 247.938435] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.504Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"eb0ba59c40006a8ed2ed352c","created_at":"2026-08-15T09:33:07.830Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-cb0a2b46c27a4110","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a2211420d47cf1f2bac13baba2faaa39","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-eb0ba59c40006a8ed2ed352c: done: 0.01639 sec","job_status":"done","queue_duration_s":1.636325,"scheduling_latency_s":1.636342,"redis_calls":13,"redis_duration_s":0.001523,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000979,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009897,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01639,"completed_at":"2026-08-15T09:33:09.504Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001555,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1659gitlab # [ 247.978423] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.505Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"4a5224c9710da5fee759f5b8","created_at":"2026-08-15T09:33:07.830Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-cb0a2b46c27a4110","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a2211420d47cf1f2bac13baba2faaa39","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-4a5224c9710da5fee759f5b8: start","job_status":"start","queue_duration_s":1.653855,"scheduling_latency_s":1.65387}1660gitlab # [ 247.991495] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.521Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"4a5224c9710da5fee759f5b8","created_at":"2026-08-15T09:33:07.830Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-cb0a2b46c27a4110","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a2211420d47cf1f2bac13baba2faaa39","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-4a5224c9710da5fee759f5b8: done: 0.015685 sec","job_status":"done","queue_duration_s":1.653855,"scheduling_latency_s":1.65387,"redis_calls":13,"redis_duration_s":0.0015609999999999999,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000542,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001019,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01033,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015685,"completed_at":"2026-08-15T09:33:09.521Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001079,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1661gitlab # [ 248.030635] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.522Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"d20803624d9c47329392abbf","created_at":"2026-08-15T09:33:07.830Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-cb0a2b46c27a4110","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a2211420d47cf1f2bac13baba2faaa39","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-d20803624d9c47329392abbf: start","job_status":"start","queue_duration_s":1.670717,"scheduling_latency_s":1.670734}1662gitlab # [ 248.043951] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.537Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"d20803624d9c47329392abbf","created_at":"2026-08-15T09:33:07.830Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-cb0a2b46c27a4110","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a2211420d47cf1f2bac13baba2faaa39","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-d20803624d9c47329392abbf: done: 0.015449 sec","job_status":"done","queue_duration_s":1.670717,"scheduling_latency_s":1.670734,"redis_calls":13,"redis_duration_s":0.001453,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000947,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010203,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015449,"completed_at":"2026-08-15T09:33:09.537Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001062,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1663gitlab # [ 248.082937] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.538Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"c84e2e4c471f49c3f6c9d1c8","created_at":"2026-08-15T09:33:07.830Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-cb0a2b46c27a4110","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a2211420d47cf1f2bac13baba2faaa39","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-c84e2e4c471f49c3f6c9d1c8: start","job_status":"start","queue_duration_s":1.687236,"scheduling_latency_s":1.687252}1664gitlab # [ 248.096106] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.554Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"c84e2e4c471f49c3f6c9d1c8","created_at":"2026-08-15T09:33:07.830Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-cb0a2b46c27a4110","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a2211420d47cf1f2bac13baba2faaa39","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-c84e2e4c471f49c3f6c9d1c8: done: 0.015404 sec","job_status":"done","queue_duration_s":1.687236,"scheduling_latency_s":1.687252,"redis_calls":13,"redis_duration_s":0.001464,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000959,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010181,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015404,"completed_at":"2026-08-15T09:33:09.554Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001101,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1665gitlab # [ 248.134837] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.555Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"a7cc4aec109d832ff5a70957","created_at":"2026-08-15T09:33:07.830Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-cb0a2b46c27a4110","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a2211420d47cf1f2bac13baba2faaa39","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-a7cc4aec109d832ff5a70957: start","job_status":"start","queue_duration_s":1.703705,"scheduling_latency_s":1.703721}1666gitlab # [ 248.148774] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.570Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"a7cc4aec109d832ff5a70957","created_at":"2026-08-15T09:33:07.830Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-cb0a2b46c27a4110","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"a2211420d47cf1f2bac13baba2faaa39","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:07.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-a7cc4aec109d832ff5a70957: done: 0.01566 sec","job_status":"done","queue_duration_s":1.703705,"scheduling_latency_s":1.703721,"redis_calls":13,"redis_duration_s":0.001487,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000944,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009844,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01566,"completed_at":"2026-08-15T09:33:09.570Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001113,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1667gitlab # [ 248.188104] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.572Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"4c33879638da0a62224fda45","created_at":"2026-08-15T09:33:08.006Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-343a2432fd1f45f6","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"faafc808f7093eb82aca5ad889464dd5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:08.015Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-4c33879638da0a62224fda45: start","job_status":"start","queue_duration_s":1.556861,"scheduling_latency_s":1.556879}1668gitlab # [ 248.200265] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.584Z","message":"No existing merge request to be cleaned up."}1669gitlab # [ 248.201901] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.593Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"4c33879638da0a62224fda45","created_at":"2026-08-15T09:33:08.006Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-343a2432fd1f45f6","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"faafc808f7093eb82aca5ad889464dd5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:08.015Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-4c33879638da0a62224fda45: done: 0.020428 sec","job_status":"done","queue_duration_s":1.556861,"scheduling_latency_s":1.556879,"redis_calls":10,"redis_duration_s":0.001354,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000561,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000793,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014004,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020428,"completed_at":"2026-08-15T09:33:09.592Z","load_balancing_strategy":"primary","db_duration_s":0.002915,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1670gitlab # [ 248.239594] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.594Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"77415fd485a13f4974774bfd","created_at":"2026-08-15T09:33:08.006Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-343a2432fd1f45f6","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"faafc808f7093eb82aca5ad889464dd5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:08.015Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-77415fd485a13f4974774bfd: start","job_status":"start","queue_duration_s":1.578372,"scheduling_latency_s":1.578388}1671gitlab # [ 248.251793] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.605Z","message":"No existing merge request to be cleaned up."}1672gitlab # [ 248.253544] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.613Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"77415fd485a13f4974774bfd","created_at":"2026-08-15T09:33:08.006Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-343a2432fd1f45f6","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"faafc808f7093eb82aca5ad889464dd5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:08.015Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-77415fd485a13f4974774bfd: done: 0.019298 sec","job_status":"done","queue_duration_s":1.578372,"scheduling_latency_s":1.578388,"redis_calls":10,"redis_duration_s":0.001823,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00107,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000753,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013385,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019298,"completed_at":"2026-08-15T09:33:09.613Z","load_balancing_strategy":"primary","db_duration_s":0.002679,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1673gitlab # [ 248.292062] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.614Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"93d109374dcacea2eed96afa","created_at":"2026-08-15T09:33:08.006Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-343a2432fd1f45f6","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"faafc808f7093eb82aca5ad889464dd5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:08.015Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-93d109374dcacea2eed96afa: start","job_status":"start","queue_duration_s":1.598731,"scheduling_latency_s":1.598747}1674gitlab # [ 248.304288] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.625Z","message":"No existing merge request to be cleaned up."}1675gitlab # [ 248.305929] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.634Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"93d109374dcacea2eed96afa","created_at":"2026-08-15T09:33:08.006Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-343a2432fd1f45f6","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"faafc808f7093eb82aca5ad889464dd5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:08.015Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-93d109374dcacea2eed96afa: done: 0.01968 sec","job_status":"done","queue_duration_s":1.598731,"scheduling_latency_s":1.598747,"redis_calls":10,"redis_duration_s":0.001342,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000604,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000738,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01334,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01968,"completed_at":"2026-08-15T09:33:09.634Z","load_balancing_strategy":"primary","db_duration_s":0.00245,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1676gitlab # [ 248.343695] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.635Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"540ec9051ddcbbc849ccef7f","created_at":"2026-08-15T09:33:08.006Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-343a2432fd1f45f6","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"faafc808f7093eb82aca5ad889464dd5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:08.015Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-540ec9051ddcbbc849ccef7f: start","job_status":"start","queue_duration_s":1.619469,"scheduling_latency_s":1.619484}1677gitlab # [ 248.356913] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.646Z","message":"No existing merge request to be cleaned up."}1678gitlab # [ 248.358530] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:33:09.654Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"540ec9051ddcbbc849ccef7f","created_at":"2026-08-15T09:33:08.006Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-343a2432fd1f45f6","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"faafc808f7093eb82aca5ad889464dd5","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:33:08.015Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-540ec9051ddcbbc849ccef7f: done: 0.019496 sec","job_status":"done","queue_duration_s":1.619469,"scheduling_latency_s":1.619484,"redis_calls":10,"redis_duration_s":0.001395,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000567,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000828,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013712,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019496,"completed_at":"2026-08-15T09:33:09.654Z","load_balancing_strategy":"primary","db_duration_s":0.002281,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1679gitlab # [ 267.251977] setup-gitlab-start[2934]: W, [2026-08-15T09:33:31.090397 #2934] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1680gitlab # [ 303.371705] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:07.209Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"957e9f9fe5d4d35df7a2b105","created_at":"2026-08-15T09:34:07.117Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9f9a55ff84862ebe3e628055435cc16f","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:07.202Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-957e9f9fe5d4d35df7a2b105: start","job_status":"start","queue_duration_s":0.006773,"scheduling_latency_s":0.00683}1681gitlab # [ 304.026387] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:07.864Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"957e9f9fe5d4d35df7a2b105","created_at":"2026-08-15T09:34:07.117Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9f9a55ff84862ebe3e628055435cc16f","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:07.202Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-957e9f9fe5d4d35df7a2b105: done: 0.655342 sec","job_status":"done","queue_duration_s":0.006773,"scheduling_latency_s":0.00683,"redis_calls":18,"redis_duration_s":0.075816,"redis_read_bytes":1032,"redis_write_bytes":1788,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.039292,"redis_feature_flag_read_bytes":1024,"redis_feature_flag_write_bytes":549,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.024945,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.011579,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.283,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.283,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.062646,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.2695004,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.655342,"completed_at":"2026-08-15T09:34:07.864Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.373233,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1682gitlab # [ 304.126421] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:07.896Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"ef56fcb81f01bcce63e4710c","created_at":"2026-08-15T09:34:07.235Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"312a13b31df4d59b80d8b46122f23573","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:07.246Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-ef56fcb81f01bcce63e4710c: start","job_status":"start","queue_duration_s":0.649874,"scheduling_latency_s":0.649926}1683gitlab # [ 304.441805] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:08.279Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"ef56fcb81f01bcce63e4710c","created_at":"2026-08-15T09:34:07.235Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"312a13b31df4d59b80d8b46122f23573","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:07.246Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-ef56fcb81f01bcce63e4710c: done: 0.382962 sec","job_status":"done","queue_duration_s":0.649874,"scheduling_latency_s":0.649926,"redis_calls":10,"redis_duration_s":0.046742000000000006,"redis_read_bytes":135,"redis_write_bytes":1227,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.004267,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":100,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.024285,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.01819,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":591,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035298,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0044663,"exclusive_lock_hold_duration_s":0.02450308,"duration_s":0.382962,"completed_at":"2026-08-15T09:34:08.278Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019541,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1684gitlab # [ 304.528375] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:08.344Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"2a0c6a25744328211a3a481d","created_at":"2026-08-15T09:34:07.254Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:07.270Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-2a0c6a25744328211a3a481d: start","job_status":"start","queue_duration_s":1.074304,"scheduling_latency_s":1.074356}1685gitlab # [ 305.056762] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:08.895Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"2a0c6a25744328211a3a481d","created_at":"2026-08-15T09:34:07.254Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:07.270Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-2a0c6a25744328211a3a481d: done: 0.550656 sec","job_status":"done","queue_duration_s":1.074304,"scheduling_latency_s":1.074356,"redis_calls":65,"redis_duration_s":0.157064,"redis_read_bytes":748,"redis_write_bytes":41502,"redis_feature_flag_calls":5,"redis_feature_flag_duration_s":0.011285,"redis_feature_flag_read_bytes":640,"redis_feature_flag_write_bytes":393,"redis_queues_calls":2,"redis_queues_duration_s":0.00352,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.133963,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.008296,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.255563,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.550656,"completed_at":"2026-08-15T09:34:08.894Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1686gitlab # [ 305.138017] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:08.899Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"23c35225cc475c7ffebf3f2c","created_at":"2026-08-15T09:34:07.305Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"178d5fa831e50d0ddf6fd58749361538","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:07.321Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-23c35225cc475c7ffebf3f2c: start","job_status":"start","queue_duration_s":1.577689,"scheduling_latency_s":1.577735}1687gitlab # [ 305.192163] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:09.028Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"23c35225cc475c7ffebf3f2c","created_at":"2026-08-15T09:34:07.305Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"178d5fa831e50d0ddf6fd58749361538","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:07.321Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-23c35225cc475c7ffebf3f2c: done: 0.128667 sec","job_status":"done","queue_duration_s":1.577689,"scheduling_latency_s":1.577735,"redis_calls":8,"redis_duration_s":0.01595,"redis_read_bytes":133,"redis_write_bytes":936,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.00413,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":110,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006807,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005013,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.049,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.049,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026312,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.128667,"completed_at":"2026-08-15T09:34:09.027Z","load_balancing_strategy":"primary","db_duration_s":0.049442,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1688gitlab # [ 305.251026] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:09.038Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"1256d3a26327b66af497a959","created_at":"2026-08-15T09:34:07.344Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dfd50c5d2a021ddab2bedd0292451a54","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:07.361Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-1256d3a26327b66af497a959: start","job_status":"start","queue_duration_s":1.677584,"scheduling_latency_s":1.677633}1689gitlab # [ 305.266412] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:09.067Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1690gitlab # [ 305.306069] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:09.144Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"1256d3a26327b66af497a959","created_at":"2026-08-15T09:34:07.344Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dfd50c5d2a021ddab2bedd0292451a54","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:07.361Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-1256d3a26327b66af497a959: done: 0.106046 sec","job_status":"done","queue_duration_s":1.677584,"scheduling_latency_s":1.677633,"redis_calls":8,"redis_duration_s":0.028613,"redis_read_bytes":133,"redis_write_bytes":937,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000275,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":111,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.027515,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000823,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023152,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.106046,"completed_at":"2026-08-15T09:34:09.144Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1691gitlab # [ 305.396566] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:09.169Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"fa5108c7d7e4e82a178089bb","created_at":"2026-08-15T09:34:07.392Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"35d4fc97b0328acca264e82ee61ba367","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:07.426Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-fa5108c7d7e4e82a178089bb: start","job_status":"start","queue_duration_s":1.742647,"scheduling_latency_s":1.742698}1692gitlab # [ 307.742414] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:11.579Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"fa5108c7d7e4e82a178089bb","created_at":"2026-08-15T09:34:07.392Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"35d4fc97b0328acca264e82ee61ba367","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:07.426Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-fa5108c7d7e4e82a178089bb: done: 2.410251 sec","job_status":"done","queue_duration_s":1.742647,"scheduling_latency_s":1.742698,"redis_calls":563,"redis_duration_s":1.4884570000000001,"redis_read_bytes":688,"redis_write_bytes":48843,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.002614,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":83,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.054333,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":1.43151,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.066407,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":2.410251,"completed_at":"2026-08-15T09:34:11.579Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1693gitlab # [ 307.748133] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:11.586Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"e9dec86f6f6cbdfa8dd8fb0c","created_at":"2026-08-15T09:34:07.478Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6feb739bf74ed9b3b268fde3edd100fa","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:07.494Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-e9dec86f6f6cbdfa8dd8fb0c: start","job_status":"start","queue_duration_s":4.092209,"scheduling_latency_s":4.092258}1694gitlab # [ 307.864912] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:11.703Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"e9dec86f6f6cbdfa8dd8fb0c","created_at":"2026-08-15T09:34:07.478Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6feb739bf74ed9b3b268fde3edd100fa","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:07.494Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-e9dec86f6f6cbdfa8dd8fb0c: done: 0.11698 sec","job_status":"done","queue_duration_s":4.092209,"scheduling_latency_s":4.092258,"redis_calls":11,"redis_duration_s":0.003863,"redis_read_bytes":263,"redis_write_bytes":1334,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00056,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":172,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001815,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001488,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042364,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00075474,"exclusive_lock_hold_duration_s":0.03036896,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.11698,"completed_at":"2026-08-15T09:34:11.703Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012811,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1695gitlab # [ 307.963831] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:11.705Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"6dd6b65aff716d27260de3cb","created_at":"2026-08-15T09:34:07.508Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5ff4dfd1f47531c94ce1a835a2903de7","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:07.518Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-6dd6b65aff716d27260de3cb: start","job_status":"start","queue_duration_s":4.187667,"scheduling_latency_s":4.187697}1696gitlab # [ 307.978035] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:11.729Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"6dd6b65aff716d27260de3cb","created_at":"2026-08-15T09:34:07.508Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5ff4dfd1f47531c94ce1a835a2903de7","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:07.518Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-6dd6b65aff716d27260de3cb: done: 0.023694 sec","job_status":"done","queue_duration_s":4.187667,"scheduling_latency_s":4.187697,"redis_calls":8,"redis_duration_s":0.00202,"redis_read_bytes":133,"redis_write_bytes":764,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000192,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":83,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001314,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000514,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01576,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023694,"completed_at":"2026-08-15T09:34:11.729Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000768,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1697gitlab # [ 308.019578] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:11.731Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"ad81054ac0f73c59df9a091f","created_at":"2026-08-15T09:34:07.544Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3be260977e60cc5ec372419b144dbd80","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:07.560Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-ad81054ac0f73c59df9a091f: start","job_status":"start","queue_duration_s":4.170967,"scheduling_latency_s":4.170991}1698gitlab # [ 308.034991] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:11.751Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"ad81054ac0f73c59df9a091f","created_at":"2026-08-15T09:34:07.544Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3be260977e60cc5ec372419b144dbd80","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:07.560Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-ad81054ac0f73c59df9a091f: done: 0.019725 sec","job_status":"done","queue_duration_s":4.170967,"scheduling_latency_s":4.170991,"redis_calls":10,"redis_duration_s":0.001765,"redis_read_bytes":389,"redis_write_bytes":1014,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000466,"redis_feature_flag_read_bytes":384,"redis_feature_flag_write_bytes":238,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00095,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000349,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01338,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019725,"completed_at":"2026-08-15T09:34:11.751Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1699gitlab # [ 308.076668] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:11.752Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"be81a895deda56ea6f53709f","created_at":"2026-08-15T09:34:07.584Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"56431442654569ebe6b1f33ca7c77633","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:07.599Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-be81a895deda56ea6f53709f: start","job_status":"start","queue_duration_s":4.152844,"scheduling_latency_s":4.152867}1700gitlab # [ 308.092345] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:11.763Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1701gitlab # [ 308.095992] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:11.769Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"be81a895deda56ea6f53709f","created_at":"2026-08-15T09:34:07.584Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"56431442654569ebe6b1f33ca7c77633","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:07.599Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-be81a895deda56ea6f53709f: done: 0.016655 sec","job_status":"done","queue_duration_s":4.152844,"scheduling_latency_s":4.152867,"redis_calls":8,"redis_duration_s":0.001494,"redis_read_bytes":133,"redis_write_bytes":931,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000152,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":110,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000968,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000374,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010943,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016655,"completed_at":"2026-08-15T09:34:11.769Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1702gitlab # [ 308.139532] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:11.770Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"ecd4b8acbb818e18edc5fc0a","created_at":"2026-08-15T09:34:07.664Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8a1ea6adb2d34588afd1bcc110ed015d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:07.680Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-ecd4b8acbb818e18edc5fc0a: start","job_status":"start","queue_duration_s":4.090036,"scheduling_latency_s":4.090056}1703gitlab # [ 308.155243] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:11.802Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"ecd4b8acbb818e18edc5fc0a","created_at":"2026-08-15T09:34:07.664Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8a1ea6adb2d34588afd1bcc110ed015d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:07.680Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-ecd4b8acbb818e18edc5fc0a: done: 0.03184 sec","job_status":"done","queue_duration_s":4.090036,"scheduling_latency_s":4.090056,"redis_calls":10,"redis_duration_s":0.0017490000000000001,"redis_read_bytes":135,"redis_write_bytes":1275,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.00032,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":106,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000728,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000701,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018894,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00058942,"exclusive_lock_hold_duration_s":0.01087734,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.03184,"completed_at":"2026-08-15T09:34:11.802Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008712,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1704gitlab # [ 308.201168] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:11.803Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"4169cc0884e5856b6e6da616","created_at":"2026-08-15T09:34:07.713Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d3b53f00bc567a0308bae54e3ec0a221","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-15T09:34:07.729Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-4169cc0884e5856b6e6da616: start","job_status":"start","queue_duration_s":4.074204,"scheduling_latency_s":4.074222}1705gitlab # [ 308.214036] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:11.823Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"4169cc0884e5856b6e6da616","created_at":"2026-08-15T09:34:07.713Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d3b53f00bc567a0308bae54e3ec0a221","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-15T09:34:07.729Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-4169cc0884e5856b6e6da616: done: 0.019742 sec","job_status":"done","queue_duration_s":4.074204,"scheduling_latency_s":4.074222,"redis_calls":8,"redis_duration_s":0.00111,"redis_read_bytes":133,"redis_write_bytes":836,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000113,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":95,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000733,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000264,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01469,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019742,"completed_at":"2026-08-15T09:34:11.823Z","load_balancing_strategy":"primary","db_duration_s":0.000757,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1706gitlab # [ 308.256850] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:11.824Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"f8eab7e43639db2376616f3b","created_at":"2026-08-15T09:34:07.770Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4635589f53ebde5658fe179c21ff3540","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:07.794Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-f8eab7e43639db2376616f3b: start","job_status":"start","queue_duration_s":4.029996,"scheduling_latency_s":4.030013}1707gitlab # [ 308.271166] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:11.860Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"f8eab7e43639db2376616f3b","created_at":"2026-08-15T09:34:07.770Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4635589f53ebde5658fe179c21ff3540","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:07.794Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-f8eab7e43639db2376616f3b: done: 0.035374 sec","job_status":"done","queue_duration_s":4.029996,"scheduling_latency_s":4.030013,"redis_calls":10,"redis_duration_s":0.001398,"redis_read_bytes":135,"redis_write_bytes":1167,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000113,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":95,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000712,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000573,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011666,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0004397,"exclusive_lock_hold_duration_s":0.00248482,"duration_s":0.035374,"completed_at":"2026-08-15T09:34:11.860Z","load_balancing_strategy":"primary","db_duration_s":0.000399,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1708gitlab # [ 308.312180] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:11.861Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"739a2295e7b82dbd696d0173","created_at":"2026-08-15T09:34:07.840Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b3daa50a122d3bb8117126bdb73ab3ff","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:07.856Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-739a2295e7b82dbd696d0173: start","job_status":"start","queue_duration_s":4.005171,"scheduling_latency_s":4.005187}1709gitlab # [ 308.325446] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:11.887Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"739a2295e7b82dbd696d0173","created_at":"2026-08-15T09:34:07.840Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b3daa50a122d3bb8117126bdb73ab3ff","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:07.856Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-739a2295e7b82dbd696d0173: done: 0.026485 sec","job_status":"done","queue_duration_s":4.005171,"scheduling_latency_s":4.005187,"redis_calls":16,"redis_duration_s":0.0023550000000000003,"redis_read_bytes":272,"redis_write_bytes":4225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000265,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":199,"redis_queues_calls":2,"redis_queues_duration_s":0.000214,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001445,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000431,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021198,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026485,"completed_at":"2026-08-15T09:34:11.887Z","load_balancing_strategy":"primary","db_duration_s":0.000555,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1710gitlab # [ 308.369037] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:11.889Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"d1d3c27e4653044f0eb9c9b7","created_at":"2026-08-15T09:34:07.890Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8a9d7ba632cbd655bba3391b87901e7d","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:07.905Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-d1d3c27e4653044f0eb9c9b7: start","job_status":"start","queue_duration_s":3.983925,"scheduling_latency_s":3.983941}1711gitlab # [ 308.384239] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:11.906Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"d1d3c27e4653044f0eb9c9b7","created_at":"2026-08-15T09:34:07.890Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8a9d7ba632cbd655bba3391b87901e7d","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:07.905Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-d1d3c27e4653044f0eb9c9b7: done: 0.01726 sec","job_status":"done","queue_duration_s":3.983925,"scheduling_latency_s":3.983941,"redis_calls":8,"redis_duration_s":0.001993,"redis_read_bytes":133,"redis_write_bytes":888,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000126,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":102,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00161,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000257,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":250,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012221,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01726,"completed_at":"2026-08-15T09:34:11.906Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000914,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1712gitlab # [ 308.425822] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:11.907Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"ca45a4bc05117a59ff682c89","created_at":"2026-08-15T09:34:07.910Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4047857fb342f4e48af361904b209b8c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-15T09:34:07.920Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-ca45a4bc05117a59ff682c89: start","job_status":"start","queue_duration_s":3.986565,"scheduling_latency_s":3.986582}1713gitlab # [ 308.439984] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:11.916Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1714gitlab # [ 308.444350] postgres[3257]: [3257] ERROR: relation "table_without_models" does not exist1715gitlab # [ 308.445467] postgres[3257]: [3257] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1716gitlab # [ 308.446747] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:11.921Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"ca45a4bc05117a59ff682c89","created_at":"2026-08-15T09:34:07.910Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4047857fb342f4e48af361904b209b8c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-15T09:34:07.920Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-ca45a4bc05117a59ff682c89: done: 0.014339 sec","job_status":"done","queue_duration_s":3.986565,"scheduling_latency_s":3.986582,"redis_calls":8,"redis_duration_s":0.001034,"redis_read_bytes":133,"redis_write_bytes":908,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000115,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":107,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000659,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00026,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008301,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014339,"completed_at":"2026-08-15T09:34:11.921Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1717gitlab # [ 308.487400] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:11.922Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"4917c0c89800235cd225b68e","created_at":"2026-08-15T09:34:07.984Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f40ba70ebcd1c19fa4c553a882b980b3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.004Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-4917c0c89800235cd225b68e: start","job_status":"start","queue_duration_s":3.918359,"scheduling_latency_s":3.918375}1718gitlab # [ 308.502355] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.153Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"4917c0c89800235cd225b68e","created_at":"2026-08-15T09:34:07.984Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f40ba70ebcd1c19fa4c553a882b980b3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.004Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-4917c0c89800235cd225b68e: done: 0.230734 sec","job_status":"done","queue_duration_s":3.918359,"scheduling_latency_s":3.918375,"redis_calls":12,"redis_duration_s":0.001848,"redis_read_bytes":137,"redis_write_bytes":1346,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000413,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000722,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000713,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":130,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.027,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.201127,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00045286,"exclusive_lock_hold_duration_s":0.21183258,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.230734,"completed_at":"2026-08-15T09:34:12.153Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.03921,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1719gitlab # [ 308.546627] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.154Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"e6c7d5046fcf23f929a34c56","created_at":"2026-08-15T09:34:08.022Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"242996ccfd1029d54dfb901e3d329849","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.034Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-e6c7d5046fcf23f929a34c56: start","job_status":"start","queue_duration_s":4.119845,"scheduling_latency_s":4.119861}1720gitlab # [ 308.561037] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.172Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"e6c7d5046fcf23f929a34c56","created_at":"2026-08-15T09:34:08.022Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"242996ccfd1029d54dfb901e3d329849","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.034Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-e6c7d5046fcf23f929a34c56: done: 0.01768 sec","job_status":"done","queue_duration_s":4.119845,"scheduling_latency_s":4.119861,"redis_calls":10,"redis_duration_s":0.0015220000000000001,"redis_read_bytes":135,"redis_write_bytes":1184,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000119,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":97,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000764,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000639,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012615,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00050588,"exclusive_lock_hold_duration_s":0.00212894,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.01768,"completed_at":"2026-08-15T09:34:12.172Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000533,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1721gitlab # [ 308.603828] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.173Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"1ac0ab840bcf9ebe12b17bb0","created_at":"2026-08-15T09:34:08.056Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1a7de143cd1134857f5f024976ff4a52","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.068Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-1ac0ab840bcf9ebe12b17bb0: start","job_status":"start","queue_duration_s":4.105293,"scheduling_latency_s":4.105309}1722gitlab # [ 308.619304] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.181Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1723gitlab # [ 308.623221] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.186Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"1ac0ab840bcf9ebe12b17bb0","created_at":"2026-08-15T09:34:08.056Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1a7de143cd1134857f5f024976ff4a52","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.068Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-1ac0ab840bcf9ebe12b17bb0: done: 0.013218 sec","job_status":"done","queue_duration_s":4.105293,"scheduling_latency_s":4.105309,"redis_calls":8,"redis_duration_s":0.00134,"redis_read_bytes":133,"redis_write_bytes":867,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000135,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":101,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000929,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000276,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008631,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013218,"completed_at":"2026-08-15T09:34:12.186Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1724gitlab # [ 308.668219] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.187Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"0a1098140eaa6d7d8aad0f1a","created_at":"2026-08-15T09:34:08.105Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"62a437d9a35967d779471974459782f3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-15T09:34:08.118Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-0a1098140eaa6d7d8aad0f1a: start","job_status":"start","queue_duration_s":4.069719,"scheduling_latency_s":4.069736}1725gitlab # [ 308.681842] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.196Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1726gitlab # [ 308.685363] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.201Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"0a1098140eaa6d7d8aad0f1a","created_at":"2026-08-15T09:34:08.105Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"62a437d9a35967d779471974459782f3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-15T09:34:08.118Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-0a1098140eaa6d7d8aad0f1a: done: 0.013778 sec","job_status":"done","queue_duration_s":4.069719,"scheduling_latency_s":4.069736,"redis_calls":8,"redis_duration_s":0.001071,"redis_read_bytes":133,"redis_write_bytes":914,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000115,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":108,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000672,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000284,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008493,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013778,"completed_at":"2026-08-15T09:34:12.201Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1727gitlab # [ 308.727681] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.202Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"00058c6d7d1ee806822a0e5c","created_at":"2026-08-15T09:34:08.156Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"10d035199e2a0c015daed83de35f0315","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.176Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-00058c6d7d1ee806822a0e5c: start","job_status":"start","queue_duration_s":4.026072,"scheduling_latency_s":4.026087}1728gitlab # [ 308.740895] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.216Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"00058c6d7d1ee806822a0e5c","created_at":"2026-08-15T09:34:08.156Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"10d035199e2a0c015daed83de35f0315","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.176Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-00058c6d7d1ee806822a0e5c: done: 0.014074 sec","job_status":"done","queue_duration_s":4.026072,"scheduling_latency_s":4.026087,"redis_calls":11,"redis_duration_s":0.0013520000000000001,"redis_read_bytes":138,"redis_write_bytes":877,"redis_cache_calls":3,"redis_cache_duration_s":0.000331,"redis_cache_read_bytes":5,"redis_cache_write_bytes":97,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000115,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":84,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000647,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":482,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000259,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":214,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008628,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014074,"completed_at":"2026-08-15T09:34:12.216Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1729gitlab # [ 308.783304] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.218Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"48870af3e72b776dd74a2ebc","created_at":"2026-08-15T09:34:08.210Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c5a2053668f220100a33d719a696c4b4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.231Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-48870af3e72b776dd74a2ebc: start","job_status":"start","queue_duration_s":3.987025,"scheduling_latency_s":3.987043}1730gitlab # [ 308.797595] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.226Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1731gitlab # [ 308.800954] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.232Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"48870af3e72b776dd74a2ebc","created_at":"2026-08-15T09:34:08.210Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c5a2053668f220100a33d719a696c4b4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.231Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-48870af3e72b776dd74a2ebc: done: 0.013704 sec","job_status":"done","queue_duration_s":3.987025,"scheduling_latency_s":3.987043,"redis_calls":8,"redis_duration_s":0.001154,"redis_read_bytes":133,"redis_write_bytes":873,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000131,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":102,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000748,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000275,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008325,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013704,"completed_at":"2026-08-15T09:34:12.232Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1732gitlab # [ 308.845523] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.233Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"7d858332d7dfa2b2db6ddbd3","created_at":"2026-08-15T09:34:08.273Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1b46f90ec06cfc2f3828c1928758e6c6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.290Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-7d858332d7dfa2b2db6ddbd3: start","job_status":"start","queue_duration_s":3.943619,"scheduling_latency_s":3.943634}1733gitlab # [ 308.860244] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.247Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"7d858332d7dfa2b2db6ddbd3","created_at":"2026-08-15T09:34:08.273Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1b46f90ec06cfc2f3828c1928758e6c6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.290Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-7d858332d7dfa2b2db6ddbd3: done: 0.014209 sec","job_status":"done","queue_duration_s":3.943619,"scheduling_latency_s":3.943634,"redis_calls":8,"redis_duration_s":0.001089,"redis_read_bytes":133,"redis_write_bytes":943,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.00011,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":112,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000699,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00028,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009742,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014209,"completed_at":"2026-08-15T09:34:12.247Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1734gitlab # [ 308.905714] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.248Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"b89bd004b5675b9b658db4ab","created_at":"2026-08-15T09:34:08.303Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9a665873d2237286e85979a7e431ca92","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.314Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-b89bd004b5675b9b658db4ab: start","job_status":"start","queue_duration_s":3.933965,"scheduling_latency_s":3.933981}1735gitlab # [ 308.919953] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.279Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"b89bd004b5675b9b658db4ab","created_at":"2026-08-15T09:34:08.303Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-b7de93349120431e","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9a665873d2237286e85979a7e431ca92","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.314Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-b89bd004b5675b9b658db4ab: done: 0.030758 sec","job_status":"done","queue_duration_s":3.933965,"scheduling_latency_s":3.933981,"redis_calls":11,"redis_duration_s":0.002547,"redis_read_bytes":517,"redis_write_bytes":1011,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001076,"redis_feature_flag_read_bytes":512,"redis_feature_flag_write_bytes":300,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001063,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000408,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024128,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030758,"completed_at":"2026-08-15T09:34:12.279Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002979,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1736gitlab # [ 308.961668] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.282Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"939e9428cdc4b883ad0e77fe","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-939e9428cdc4b883ad0e77fe: start","job_status":"start","queue_duration_s":3.431252,"scheduling_latency_s":3.431297}1737gitlab # [ 308.973985] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.326Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"939e9428cdc4b883ad0e77fe","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-939e9428cdc4b883ad0e77fe: done: 0.043764 sec","job_status":"done","queue_duration_s":3.431252,"scheduling_latency_s":3.431297,"redis_calls":14,"redis_duration_s":0.004116,"redis_read_bytes":138,"redis_write_bytes":1242,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000274,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":85,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001442,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0024,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028099,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.043764,"completed_at":"2026-08-15T09:34:12.326Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1738gitlab # [ 309.014515] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.328Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"17994482aa7cb899bdffa2a2","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-17994482aa7cb899bdffa2a2: start","job_status":"start","queue_duration_s":3.477716,"scheduling_latency_s":3.477752}1739gitlab # [ 309.026888] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.361Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"17994482aa7cb899bdffa2a2","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-17994482aa7cb899bdffa2a2: done: 0.033106 sec","job_status":"done","queue_duration_s":3.477716,"scheduling_latency_s":3.477752,"redis_calls":13,"redis_duration_s":0.003854,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001269,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002585,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022468,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033106,"completed_at":"2026-08-15T09:34:12.361Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1740gitlab # [ 309.065613] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.364Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e949a04587197fca3bd883e","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e949a04587197fca3bd883e: start","job_status":"start","queue_duration_s":3.513465,"scheduling_latency_s":3.513509}1741gitlab # [ 309.079508] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.403Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e949a04587197fca3bd883e","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e949a04587197fca3bd883e: done: 0.038813 sec","job_status":"done","queue_duration_s":3.513465,"scheduling_latency_s":3.513509,"redis_calls":13,"redis_duration_s":0.0046029999999999995,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00166,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002943,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027448,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.038813,"completed_at":"2026-08-15T09:34:12.403Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1742gitlab # [ 309.120494] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.405Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b545256bebeb8bce55459eb","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b545256bebeb8bce55459eb: start","job_status":"start","queue_duration_s":3.554616,"scheduling_latency_s":3.554642}1743gitlab # [ 309.132613] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.432Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b545256bebeb8bce55459eb","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b545256bebeb8bce55459eb: done: 0.026278 sec","job_status":"done","queue_duration_s":3.554616,"scheduling_latency_s":3.554642,"redis_calls":13,"redis_duration_s":0.003452,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001154,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002298,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01615,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026278,"completed_at":"2026-08-15T09:34:12.431Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1744gitlab # [ 309.172392] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.435Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"282735be93c7ceced6024068","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-282735be93c7ceced6024068: start","job_status":"start","queue_duration_s":3.583903,"scheduling_latency_s":3.583925}1745gitlab # [ 309.185603] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.456Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"282735be93c7ceced6024068","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-282735be93c7ceced6024068: done: 0.021235 sec","job_status":"done","queue_duration_s":3.583903,"scheduling_latency_s":3.583925,"redis_calls":13,"redis_duration_s":0.0031390000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001076,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002063,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013948,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021235,"completed_at":"2026-08-15T09:34:12.456Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1746gitlab # [ 309.227175] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.458Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"13f34b289c494766fc09ce2e","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-13f34b289c494766fc09ce2e: start","job_status":"start","queue_duration_s":3.606841,"scheduling_latency_s":3.606864}1747gitlab # [ 309.239818] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.475Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"13f34b289c494766fc09ce2e","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-13f34b289c494766fc09ce2e: done: 0.017277 sec","job_status":"done","queue_duration_s":3.606841,"scheduling_latency_s":3.606864,"redis_calls":13,"redis_duration_s":0.002548,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000925,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001623,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011208,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017277,"completed_at":"2026-08-15T09:34:12.475Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1748gitlab # [ 309.281930] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.476Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f47df6097ba42d5bb9b260d0","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f47df6097ba42d5bb9b260d0: start","job_status":"start","queue_duration_s":3.62539,"scheduling_latency_s":3.625406}1749gitlab # [ 309.295945] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.493Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f47df6097ba42d5bb9b260d0","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f47df6097ba42d5bb9b260d0: done: 0.016614 sec","job_status":"done","queue_duration_s":3.62539,"scheduling_latency_s":3.625406,"redis_calls":13,"redis_duration_s":0.003203,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000949,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002254,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009617,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016614,"completed_at":"2026-08-15T09:34:12.493Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1750gitlab # [ 309.337041] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.495Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ed12810f29b353d25e6d06ff","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ed12810f29b353d25e6d06ff: start","job_status":"start","queue_duration_s":3.644333,"scheduling_latency_s":3.644349}1751gitlab # [ 309.349053] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.511Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ed12810f29b353d25e6d06ff","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ed12810f29b353d25e6d06ff: done: 0.015908 sec","job_status":"done","queue_duration_s":3.644333,"scheduling_latency_s":3.644349,"redis_calls":13,"redis_duration_s":0.002828,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000988,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00184,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010265,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015908,"completed_at":"2026-08-15T09:34:12.511Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1752gitlab # [ 309.389404] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.512Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"494705819ed63059eb104150","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-494705819ed63059eb104150: start","job_status":"start","queue_duration_s":3.661673,"scheduling_latency_s":3.661686}1753gitlab # [ 309.402738] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.528Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"494705819ed63059eb104150","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-494705819ed63059eb104150: done: 0.01556 sec","job_status":"done","queue_duration_s":3.661673,"scheduling_latency_s":3.661686,"redis_calls":13,"redis_duration_s":0.002648,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000902,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001746,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01009,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01556,"completed_at":"2026-08-15T09:34:12.528Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1754gitlab # [ 309.441750] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.529Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff4f82b2b90dade76cf5b03a","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff4f82b2b90dade76cf5b03a: start","job_status":"start","queue_duration_s":3.678583,"scheduling_latency_s":3.678598}1755gitlab # [ 309.454217] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.545Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ff4f82b2b90dade76cf5b03a","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ff4f82b2b90dade76cf5b03a: done: 0.01594 sec","job_status":"done","queue_duration_s":3.678583,"scheduling_latency_s":3.678598,"redis_calls":13,"redis_duration_s":0.002788,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00096,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001828,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010379,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01594,"completed_at":"2026-08-15T09:34:12.545Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1756gitlab # [ 309.492869] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.547Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3630f805868be6fc8d5a1ab4","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3630f805868be6fc8d5a1ab4: start","job_status":"start","queue_duration_s":3.695931,"scheduling_latency_s":3.695946}1757gitlab # [ 309.506809] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.566Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3630f805868be6fc8d5a1ab4","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3630f805868be6fc8d5a1ab4: done: 0.019529 sec","job_status":"done","queue_duration_s":3.695931,"scheduling_latency_s":3.695946,"redis_calls":13,"redis_duration_s":0.002637,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000914,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001723,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008931,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019529,"completed_at":"2026-08-15T09:34:12.566Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1758gitlab # [ 309.545685] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.568Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7601201a80e4fa7ca2d83e28","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7601201a80e4fa7ca2d83e28: start","job_status":"start","queue_duration_s":3.716822,"scheduling_latency_s":3.716837}1759gitlab # [ 309.557868] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.583Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7601201a80e4fa7ca2d83e28","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7601201a80e4fa7ca2d83e28: done: 0.015408 sec","job_status":"done","queue_duration_s":3.716822,"scheduling_latency_s":3.716837,"redis_calls":13,"redis_duration_s":0.002792,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000962,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00183,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009909,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015408,"completed_at":"2026-08-15T09:34:12.583Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1760gitlab # [ 309.596532] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.584Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d431e5d2be1ea34ffa34acd8","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d431e5d2be1ea34ffa34acd8: start","job_status":"start","queue_duration_s":3.733612,"scheduling_latency_s":3.733628}1761gitlab # [ 309.608611] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.601Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d431e5d2be1ea34ffa34acd8","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d431e5d2be1ea34ffa34acd8: done: 0.01624 sec","job_status":"done","queue_duration_s":3.733612,"scheduling_latency_s":3.733628,"redis_calls":13,"redis_duration_s":0.003016,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001022,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001994,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010398,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01624,"completed_at":"2026-08-15T09:34:12.600Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1762gitlab # [ 309.647247] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.602Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"15961a9c8b9288f902224343","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-15961a9c8b9288f902224343: start","job_status":"start","queue_duration_s":3.751219,"scheduling_latency_s":3.751234}1763gitlab # [ 309.659772] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.618Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"15961a9c8b9288f902224343","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-15961a9c8b9288f902224343: done: 0.01648 sec","job_status":"done","queue_duration_s":3.751219,"scheduling_latency_s":3.751234,"redis_calls":13,"redis_duration_s":0.002675,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000909,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001766,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008995,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01648,"completed_at":"2026-08-15T09:34:12.618Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1764gitlab # [ 309.701769] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.620Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"43e9f5c46ff26ec88a3fa9c7","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-43e9f5c46ff26ec88a3fa9c7: start","job_status":"start","queue_duration_s":3.76906,"scheduling_latency_s":3.769074}1765gitlab # [ 309.715034] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.635Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"43e9f5c46ff26ec88a3fa9c7","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-43e9f5c46ff26ec88a3fa9c7: done: 0.015673 sec","job_status":"done","queue_duration_s":3.76906,"scheduling_latency_s":3.769074,"redis_calls":13,"redis_duration_s":0.002691,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000917,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001774,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010134,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015673,"completed_at":"2026-08-15T09:34:12.635Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1766gitlab # [ 309.756562] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.637Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"50ba504f60fca6d4297d0779","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-50ba504f60fca6d4297d0779: start","job_status":"start","queue_duration_s":3.786148,"scheduling_latency_s":3.786163}1767gitlab # [ 309.769606] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.653Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"50ba504f60fca6d4297d0779","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-50ba504f60fca6d4297d0779: done: 0.015758 sec","job_status":"done","queue_duration_s":3.786148,"scheduling_latency_s":3.786163,"redis_calls":13,"redis_duration_s":0.002739,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000963,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001776,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010174,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015758,"completed_at":"2026-08-15T09:34:12.653Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1768gitlab # [ 309.810585] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.654Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f2f7d8af52d19fd7e5d6e6b","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f2f7d8af52d19fd7e5d6e6b: start","job_status":"start","queue_duration_s":3.803291,"scheduling_latency_s":3.803305}1769gitlab # [ 309.823019] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.669Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f2f7d8af52d19fd7e5d6e6b","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f2f7d8af52d19fd7e5d6e6b: done: 0.015518 sec","job_status":"done","queue_duration_s":3.803291,"scheduling_latency_s":3.803305,"redis_calls":13,"redis_duration_s":0.0027990000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000895,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001904,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009116,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015518,"completed_at":"2026-08-15T09:34:12.669Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1770gitlab # [ 309.862150] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.672Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b277096635493e28558e828f","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b277096635493e28558e828f: start","job_status":"start","queue_duration_s":3.821001,"scheduling_latency_s":3.821017}1771gitlab # [ 309.874608] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.688Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b277096635493e28558e828f","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b277096635493e28558e828f: done: 0.015932 sec","job_status":"done","queue_duration_s":3.821001,"scheduling_latency_s":3.821017,"redis_calls":13,"redis_duration_s":0.002764,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000956,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001808,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010212,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015932,"completed_at":"2026-08-15T09:34:12.688Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1772gitlab # [ 309.916171] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.689Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"efd54616ca2d23a5e09f513f","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-efd54616ca2d23a5e09f513f: start","job_status":"start","queue_duration_s":3.838723,"scheduling_latency_s":3.838738}1773gitlab # [ 309.929348] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.705Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"efd54616ca2d23a5e09f513f","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-efd54616ca2d23a5e09f513f: done: 0.015822 sec","job_status":"done","queue_duration_s":3.838723,"scheduling_latency_s":3.838738,"redis_calls":13,"redis_duration_s":0.0027660000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000973,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001793,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010289,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015822,"completed_at":"2026-08-15T09:34:12.705Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1774gitlab # [ 309.968385] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.707Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c67ad29853c1965516c4d20","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c67ad29853c1965516c4d20: start","job_status":"start","queue_duration_s":3.855892,"scheduling_latency_s":3.855906}1775gitlab # [ 309.981444] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.722Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c67ad29853c1965516c4d20","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c67ad29853c1965516c4d20: done: 0.015574 sec","job_status":"done","queue_duration_s":3.855892,"scheduling_latency_s":3.855906,"redis_calls":13,"redis_duration_s":0.0027400000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00093,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00181,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010047,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015574,"completed_at":"2026-08-15T09:34:12.722Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1776gitlab # [ 310.023092] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.724Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"299c712908418c24fafd27db","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-299c712908418c24fafd27db: start","job_status":"start","queue_duration_s":3.873741,"scheduling_latency_s":3.873758}1777gitlab # [ 310.035394] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.740Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"299c712908418c24fafd27db","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-299c712908418c24fafd27db: done: 0.015673 sec","job_status":"done","queue_duration_s":3.873741,"scheduling_latency_s":3.873758,"redis_calls":13,"redis_duration_s":0.002719,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000971,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001748,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010056,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015673,"completed_at":"2026-08-15T09:34:12.740Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1778gitlab # [ 310.074424] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.742Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9a347d22db7d67c68ee43d37","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9a347d22db7d67c68ee43d37: start","job_status":"start","queue_duration_s":3.8908,"scheduling_latency_s":3.890814}1779gitlab # [ 310.086848] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.757Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9a347d22db7d67c68ee43d37","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9a347d22db7d67c68ee43d37: done: 0.0157 sec","job_status":"done","queue_duration_s":3.8908,"scheduling_latency_s":3.890814,"redis_calls":13,"redis_duration_s":0.002768,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00096,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001808,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010066,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0157,"completed_at":"2026-08-15T09:34:12.757Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1780gitlab # [ 310.125429] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.759Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"34683edd4c4bf8f5e23ff5ec","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-34683edd4c4bf8f5e23ff5ec: start","job_status":"start","queue_duration_s":3.907833,"scheduling_latency_s":3.907847}1781gitlab # [ 310.138605] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.774Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"34683edd4c4bf8f5e23ff5ec","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-34683edd4c4bf8f5e23ff5ec: done: 0.015336 sec","job_status":"done","queue_duration_s":3.907833,"scheduling_latency_s":3.907847,"redis_calls":13,"redis_duration_s":0.002615,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000893,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001722,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00992,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015336,"completed_at":"2026-08-15T09:34:12.774Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1782gitlab # [ 310.177376] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.776Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ecee69fcd089bb816cbc290","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ecee69fcd089bb816cbc290: start","job_status":"start","queue_duration_s":3.925433,"scheduling_latency_s":3.925451}1783gitlab # [ 310.190559] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.792Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ecee69fcd089bb816cbc290","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ecee69fcd089bb816cbc290: done: 0.016124 sec","job_status":"done","queue_duration_s":3.925433,"scheduling_latency_s":3.925451,"redis_calls":13,"redis_duration_s":0.003182,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001319,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001863,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009887,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016124,"completed_at":"2026-08-15T09:34:12.792Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1784gitlab # [ 310.233226] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.794Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a5c46b8c4a37308f6c364d70","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a5c46b8c4a37308f6c364d70: start","job_status":"start","queue_duration_s":3.942945,"scheduling_latency_s":3.94296}1785gitlab # [ 310.247021] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.809Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a5c46b8c4a37308f6c364d70","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a5c46b8c4a37308f6c364d70: done: 0.015611 sec","job_status":"done","queue_duration_s":3.942945,"scheduling_latency_s":3.94296,"redis_calls":13,"redis_duration_s":0.002806,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000936,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00187,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010062,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015611,"completed_at":"2026-08-15T09:34:12.809Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1786gitlab # [ 310.287670] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.811Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa1c838460eaf0c680978c29","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa1c838460eaf0c680978c29: start","job_status":"start","queue_duration_s":3.959862,"scheduling_latency_s":3.959877}1787gitlab # [ 310.300459] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.826Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa1c838460eaf0c680978c29","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa1c838460eaf0c680978c29: done: 0.015798 sec","job_status":"done","queue_duration_s":3.959862,"scheduling_latency_s":3.959877,"redis_calls":13,"redis_duration_s":0.002893,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000973,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00192,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010255,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015798,"completed_at":"2026-08-15T09:34:12.826Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1788gitlab # [ 310.339659] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.828Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9a57a345395f97120f928ce3","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9a57a345395f97120f928ce3: start","job_status":"start","queue_duration_s":3.977019,"scheduling_latency_s":3.977034}1789gitlab # [ 310.353424] redis[793]: 10 changes in 300 seconds. Saving...1790gitlab # [ 310.354485] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.853Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9a57a345395f97120f928ce3","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9a57a345395f97120f928ce3: done: 0.025424 sec","job_status":"done","queue_duration_s":3.977019,"scheduling_latency_s":3.977034,"redis_calls":13,"redis_duration_s":0.002664,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000912,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001752,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008963,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025424,"completed_at":"2026-08-15T09:34:12.853Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1791gitlab # [ 310.397208] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.855Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"82a7e055c757d4bb43322a43","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-82a7e055c757d4bb43322a43: start","job_status":"start","queue_duration_s":4.004469,"scheduling_latency_s":4.004484}1792gitlab # [ 310.409308] redis[793]: Background saving started by pid 32931793gitlab # [ 310.410237] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.871Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"82a7e055c757d4bb43322a43","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-82a7e055c757d4bb43322a43: done: 0.015602 sec","job_status":"done","queue_duration_s":4.004469,"scheduling_latency_s":4.004484,"redis_calls":13,"redis_duration_s":0.0034879999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001667,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001821,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009975,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015602,"completed_at":"2026-08-15T09:34:12.871Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1794gitlab # [ 310.450316] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.872Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb16c9491fe4ca7d6badb30b","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb16c9491fe4ca7d6badb30b: start","job_status":"start","queue_duration_s":4.02135,"scheduling_latency_s":4.021365}1795gitlab # [ 310.463714] redis[3293]: BGSAVE done, 448 keys saved, 0 keys skipped, 119349 bytes written.1796gitlab # [ 310.465018] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.888Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb16c9491fe4ca7d6badb30b","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb16c9491fe4ca7d6badb30b: done: 0.015507 sec","job_status":"done","queue_duration_s":4.02135,"scheduling_latency_s":4.021365,"redis_calls":13,"redis_duration_s":0.002682,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000914,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001768,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009988,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015507,"completed_at":"2026-08-15T09:34:12.887Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1797gitlab # [ 310.503480] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.889Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0fd2ff3bdb409fdfbbddf467","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0fd2ff3bdb409fdfbbddf467: start","job_status":"start","queue_duration_s":4.038201,"scheduling_latency_s":4.038216}1798gitlab # [ 310.515969] redis[3293]: DB saved on disk1799gitlab # [ 310.516803] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.904Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0fd2ff3bdb409fdfbbddf467","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0fd2ff3bdb409fdfbbddf467: done: 0.015608 sec","job_status":"done","queue_duration_s":4.038201,"scheduling_latency_s":4.038216,"redis_calls":13,"redis_duration_s":0.002777,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000955,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001822,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01006,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015608,"completed_at":"2026-08-15T09:34:12.904Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1800gitlab # [ 310.557811] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.907Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d0066b0bdca9ee350bf36f8","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d0066b0bdca9ee350bf36f8: start","job_status":"start","queue_duration_s":4.056064,"scheduling_latency_s":4.05608}1801gitlab # [ 310.569872] redis[3293]: Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB1802gitlab # [ 310.570939] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.922Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d0066b0bdca9ee350bf36f8","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d0066b0bdca9ee350bf36f8: done: 0.014948 sec","job_status":"done","queue_duration_s":4.056064,"scheduling_latency_s":4.05608,"redis_calls":13,"redis_duration_s":0.002686,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000921,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001765,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009313,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014948,"completed_at":"2026-08-15T09:34:12.922Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1803gitlab # [ 310.612176] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.923Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c7e0fb356ccfceb01c0259e","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c7e0fb356ccfceb01c0259e: start","job_status":"start","queue_duration_s":4.072334,"scheduling_latency_s":4.072349}1804gitlab # [ 310.625100] redis[793]: Background saving terminated with success1805gitlab # [ 310.626077] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.938Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c7e0fb356ccfceb01c0259e","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c7e0fb356ccfceb01c0259e: done: 0.01527 sec","job_status":"done","queue_duration_s":4.072334,"scheduling_latency_s":4.072349,"redis_calls":13,"redis_duration_s":0.0031609999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000949,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002212,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009696,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01527,"completed_at":"2026-08-15T09:34:12.938Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1806gitlab # [ 310.664826] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.940Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e1f9e75ad54560d49eebddfd","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e1f9e75ad54560d49eebddfd: start","job_status":"start","queue_duration_s":4.089089,"scheduling_latency_s":4.089104}1807gitlab # [ 310.676851] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.955Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e1f9e75ad54560d49eebddfd","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e1f9e75ad54560d49eebddfd: done: 0.015143 sec","job_status":"done","queue_duration_s":4.089089,"scheduling_latency_s":4.089104,"redis_calls":13,"redis_duration_s":0.002831,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000968,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001863,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009474,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015143,"completed_at":"2026-08-15T09:34:12.955Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1808gitlab # [ 310.715617] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.957Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28e0a8df63ed5273f135ee82","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28e0a8df63ed5273f135ee82: start","job_status":"start","queue_duration_s":4.10605,"scheduling_latency_s":4.106066}1809gitlab # [ 310.728086] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.972Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28e0a8df63ed5273f135ee82","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28e0a8df63ed5273f135ee82: done: 0.015167 sec","job_status":"done","queue_duration_s":4.10605,"scheduling_latency_s":4.106066,"redis_calls":13,"redis_duration_s":0.0026709999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000923,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001748,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009648,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015167,"completed_at":"2026-08-15T09:34:12.972Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1810gitlab # [ 310.768762] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.973Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2307163994a48dd2d08435fa","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2307163994a48dd2d08435fa: start","job_status":"start","queue_duration_s":4.122548,"scheduling_latency_s":4.122563}1811gitlab # [ 310.781684] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.989Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2307163994a48dd2d08435fa","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2307163994a48dd2d08435fa: done: 0.015609 sec","job_status":"done","queue_duration_s":4.122548,"scheduling_latency_s":4.122563,"redis_calls":13,"redis_duration_s":0.0028380000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000988,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00185,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009974,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015609,"completed_at":"2026-08-15T09:34:12.989Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1812gitlab # [ 310.823221] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:12.990Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"73a23f66175769e6a2e77b5b","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-73a23f66175769e6a2e77b5b: start","job_status":"start","queue_duration_s":4.139556,"scheduling_latency_s":4.139571}1813gitlab # [ 310.835490] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:13.005Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"73a23f66175769e6a2e77b5b","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-73a23f66175769e6a2e77b5b: done: 0.01489 sec","job_status":"done","queue_duration_s":4.139556,"scheduling_latency_s":4.139571,"redis_calls":13,"redis_duration_s":0.0025009999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000915,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001586,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009546,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01489,"completed_at":"2026-08-15T09:34:13.005Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1814gitlab # [ 310.874909] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:13.006Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c99e8c28d444613bf31b5ef2","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c99e8c28d444613bf31b5ef2: start","job_status":"start","queue_duration_s":4.155768,"scheduling_latency_s":4.155783}1815gitlab # [ 310.887335] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:13.025Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c99e8c28d444613bf31b5ef2","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c99e8c28d444613bf31b5ef2: done: 0.018189 sec","job_status":"done","queue_duration_s":4.155768,"scheduling_latency_s":4.155783,"redis_calls":13,"redis_duration_s":0.002801,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000963,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001838,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009363,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018189,"completed_at":"2026-08-15T09:34:13.025Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1816gitlab # [ 310.926116] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:13.026Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"10910b8b2ea921d066519435","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-10910b8b2ea921d066519435: start","job_status":"start","queue_duration_s":4.175166,"scheduling_latency_s":4.175182}1817gitlab # [ 310.938555] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:13.041Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"10910b8b2ea921d066519435","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-10910b8b2ea921d066519435: done: 0.015662 sec","job_status":"done","queue_duration_s":4.175166,"scheduling_latency_s":4.175182,"redis_calls":13,"redis_duration_s":0.0015830000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000553,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00103,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011138,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015662,"completed_at":"2026-08-15T09:34:13.041Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1818gitlab # [ 310.981675] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:13.043Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c6fa0c6ecdd5cfdaa831e051","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c6fa0c6ecdd5cfdaa831e051: start","job_status":"start","queue_duration_s":4.191857,"scheduling_latency_s":4.191872}1819gitlab # [ 310.995420] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:13.058Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c6fa0c6ecdd5cfdaa831e051","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c6fa0c6ecdd5cfdaa831e051: done: 0.015128 sec","job_status":"done","queue_duration_s":4.191857,"scheduling_latency_s":4.191872,"redis_calls":13,"redis_duration_s":0.0015699999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000574,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000996,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010739,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015128,"completed_at":"2026-08-15T09:34:13.058Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1820gitlab # [ 311.038287] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:13.059Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3383668d1625d76fafa9bf27","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3383668d1625d76fafa9bf27: start","job_status":"start","queue_duration_s":4.208073,"scheduling_latency_s":4.208092}1821gitlab # [ 311.050950] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:13.074Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3383668d1625d76fafa9bf27","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3383668d1625d76fafa9bf27: done: 0.014793 sec","job_status":"done","queue_duration_s":4.208073,"scheduling_latency_s":4.208092,"redis_calls":13,"redis_duration_s":0.001552,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000583,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000969,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009637,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014793,"completed_at":"2026-08-15T09:34:13.073Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1822gitlab # [ 311.090116] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:13.075Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80427cf044ac91e481ce6eb5","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80427cf044ac91e481ce6eb5: start","job_status":"start","queue_duration_s":4.224564,"scheduling_latency_s":4.224582}1823gitlab # [ 311.102501] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:13.089Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80427cf044ac91e481ce6eb5","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80427cf044ac91e481ce6eb5: done: 0.0143 sec","job_status":"done","queue_duration_s":4.224564,"scheduling_latency_s":4.224582,"redis_calls":13,"redis_duration_s":0.001437,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000897,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009927,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0143,"completed_at":"2026-08-15T09:34:13.089Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1824gitlab # [ 311.144466] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:13.091Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"48132b55d5e6dc60ba7c95cc","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-48132b55d5e6dc60ba7c95cc: start","job_status":"start","queue_duration_s":4.239824,"scheduling_latency_s":4.239839}1825gitlab # [ 311.157848] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:13.105Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"48132b55d5e6dc60ba7c95cc","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-48132b55d5e6dc60ba7c95cc: done: 0.01489 sec","job_status":"done","queue_duration_s":4.239824,"scheduling_latency_s":4.239839,"redis_calls":13,"redis_duration_s":0.0015179999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000556,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000962,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010278,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01489,"completed_at":"2026-08-15T09:34:13.105Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1826gitlab # [ 311.200452] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:13.106Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db5fde22fd08567272151e4e","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db5fde22fd08567272151e4e: start","job_status":"start","queue_duration_s":4.255787,"scheduling_latency_s":4.255803}1827gitlab # [ 311.213626] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:13.121Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db5fde22fd08567272151e4e","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db5fde22fd08567272151e4e: done: 0.01457 sec","job_status":"done","queue_duration_s":4.255787,"scheduling_latency_s":4.255803,"redis_calls":13,"redis_duration_s":0.0014780000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000519,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000959,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010128,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01457,"completed_at":"2026-08-15T09:34:13.121Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1828gitlab # [ 311.252554] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:13.122Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b2a6256fbdf4e5d316b93066","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b2a6256fbdf4e5d316b93066: start","job_status":"start","queue_duration_s":4.27137,"scheduling_latency_s":4.271386}1829gitlab # [ 311.264648] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:13.137Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b2a6256fbdf4e5d316b93066","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b2a6256fbdf4e5d316b93066: done: 0.014948 sec","job_status":"done","queue_duration_s":4.27137,"scheduling_latency_s":4.271386,"redis_calls":13,"redis_duration_s":0.0014060000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000874,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01007,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014948,"completed_at":"2026-08-15T09:34:13.137Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1830gitlab # [ 311.304464] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:13.138Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abbacb13042bb474fdb52130","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abbacb13042bb474fdb52130: start","job_status":"start","queue_duration_s":4.287359,"scheduling_latency_s":4.287374}1831gitlab # [ 311.316503] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:13.153Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abbacb13042bb474fdb52130","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abbacb13042bb474fdb52130: done: 0.01487 sec","job_status":"done","queue_duration_s":4.287359,"scheduling_latency_s":4.287374,"redis_calls":13,"redis_duration_s":0.00147,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000558,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000912,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010501,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01487,"completed_at":"2026-08-15T09:34:13.153Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1832gitlab # [ 311.356181] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:13.154Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20c90d682e15d47003031b82","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20c90d682e15d47003031b82: start","job_status":"start","queue_duration_s":4.303291,"scheduling_latency_s":4.303307}1833gitlab # [ 311.369207] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:13.168Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20c90d682e15d47003031b82","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20c90d682e15d47003031b82: done: 0.014487 sec","job_status":"done","queue_duration_s":4.303291,"scheduling_latency_s":4.303307,"redis_calls":13,"redis_duration_s":0.001405,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000881,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010201,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014487,"completed_at":"2026-08-15T09:34:13.168Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1834gitlab # [ 311.411592] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:13.170Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6cfef9361a94f9b14e8c342a","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6cfef9361a94f9b14e8c342a: start","job_status":"start","queue_duration_s":4.318848,"scheduling_latency_s":4.318863}1835gitlab # [ 311.424142] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:13.184Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6cfef9361a94f9b14e8c342a","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6cfef9361a94f9b14e8c342a: done: 0.014566 sec","job_status":"done","queue_duration_s":4.318848,"scheduling_latency_s":4.318863,"redis_calls":13,"redis_duration_s":0.001379,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000502,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000877,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009422,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014566,"completed_at":"2026-08-15T09:34:13.184Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1836gitlab # [ 311.465616] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:13.185Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc106e75ad2c6493426031bc","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc106e75ad2c6493426031bc: start","job_status":"start","queue_duration_s":4.334515,"scheduling_latency_s":4.334531}1837gitlab # [ 311.478863] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:13.200Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc106e75ad2c6493426031bc","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc106e75ad2c6493426031bc: done: 0.014713 sec","job_status":"done","queue_duration_s":4.334515,"scheduling_latency_s":4.334531,"redis_calls":13,"redis_duration_s":0.001731,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001193,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010151,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014713,"completed_at":"2026-08-15T09:34:13.200Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1838gitlab # [ 311.520526] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:13.201Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dfb26e011621d9e6bd76a941","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dfb26e011621d9e6bd76a941: start","job_status":"start","queue_duration_s":4.350294,"scheduling_latency_s":4.35031}1839gitlab # [ 311.532760] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:13.215Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dfb26e011621d9e6bd76a941","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dfb26e011621d9e6bd76a941: done: 0.014204 sec","job_status":"done","queue_duration_s":4.350294,"scheduling_latency_s":4.35031,"redis_calls":13,"redis_duration_s":0.0013930000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000885,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01001,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014204,"completed_at":"2026-08-15T09:34:13.215Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1840gitlab # [ 311.571627] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:13.216Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d970711a4c56366a08261841","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d970711a4c56366a08261841: start","job_status":"start","queue_duration_s":4.365571,"scheduling_latency_s":4.365586}1841gitlab # [ 311.584171] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:13.230Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d970711a4c56366a08261841","created_at":"2026-08-15T09:34:08.407Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-34a666fbb958495b","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a9c7f38bfe7ce88abdae9bb5877350be","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:08.851Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d970711a4c56366a08261841: done: 0.013997 sec","job_status":"done","queue_duration_s":4.365571,"scheduling_latency_s":4.365586,"redis_calls":13,"redis_duration_s":0.001409,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000904,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009432,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013997,"completed_at":"2026-08-15T09:34:13.230Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1842gitlab # [ 311.625418] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:13.232Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7ae8de02f32ebf21eb9551b5","created_at":"2026-08-15T09:34:11.872Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-ecfb28b1b3804b86","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b3daa50a122d3bb8117126bdb73ab3ff","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:11.882Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7ae8de02f32ebf21eb9551b5: start","job_status":"start","queue_duration_s":1.350244,"scheduling_latency_s":1.350262}1843gitlab # [ 311.637602] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:13.244Z","message":"No existing merge request to be cleaned up."}1844gitlab # [ 311.639209] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:13.252Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"7ae8de02f32ebf21eb9551b5","created_at":"2026-08-15T09:34:11.872Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-ecfb28b1b3804b86","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b3daa50a122d3bb8117126bdb73ab3ff","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:11.882Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-7ae8de02f32ebf21eb9551b5: done: 0.020601 sec","job_status":"done","queue_duration_s":1.350244,"scheduling_latency_s":1.350262,"redis_calls":11,"redis_duration_s":0.001474,"redis_read_bytes":136,"redis_write_bytes":1104,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000129,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":82,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000574,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000771,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015076,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020601,"completed_at":"2026-08-15T09:34:13.252Z","load_balancing_strategy":"primary","db_duration_s":0.001891,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1845gitlab # [ 311.678755] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:13.254Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"4c16071dd71aebc00c557f5c","created_at":"2026-08-15T09:34:11.872Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-ecfb28b1b3804b86","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b3daa50a122d3bb8117126bdb73ab3ff","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:11.882Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-4c16071dd71aebc00c557f5c: start","job_status":"start","queue_duration_s":1.371919,"scheduling_latency_s":1.371935}1846gitlab # [ 311.691917] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:13.264Z","message":"No existing merge request to be cleaned up."}1847gitlab # [ 311.694041] postgres[862]: [862] LOG: checkpoint starting: time1848gitlab # [ 311.694868] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:13.271Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"4c16071dd71aebc00c557f5c","created_at":"2026-08-15T09:34:11.872Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-ecfb28b1b3804b86","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b3daa50a122d3bb8117126bdb73ab3ff","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:11.882Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-4c16071dd71aebc00c557f5c: done: 0.017798 sec","job_status":"done","queue_duration_s":1.371919,"scheduling_latency_s":1.371935,"redis_calls":10,"redis_duration_s":0.001304,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000763,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012961,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017798,"completed_at":"2026-08-15T09:34:13.271Z","load_balancing_strategy":"primary","db_duration_s":0.001222,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1849gitlab # [ 311.733034] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:13.272Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"4a8f87c73261a22ba720294c","created_at":"2026-08-15T09:34:11.872Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-ecfb28b1b3804b86","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b3daa50a122d3bb8117126bdb73ab3ff","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:11.882Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-4a8f87c73261a22ba720294c: start","job_status":"start","queue_duration_s":1.390756,"scheduling_latency_s":1.390771}1850gitlab # [ 311.744938] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:13.282Z","message":"No existing merge request to be cleaned up."}1851gitlab # [ 311.746568] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:13.291Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"4a8f87c73261a22ba720294c","created_at":"2026-08-15T09:34:11.872Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-ecfb28b1b3804b86","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b3daa50a122d3bb8117126bdb73ab3ff","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:11.882Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-4a8f87c73261a22ba720294c: done: 0.018368 sec","job_status":"done","queue_duration_s":1.390756,"scheduling_latency_s":1.390771,"redis_calls":10,"redis_duration_s":0.001351,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000572,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000779,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013091,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018368,"completed_at":"2026-08-15T09:34:13.291Z","load_balancing_strategy":"primary","db_duration_s":0.001264,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1852gitlab # [ 311.784631] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:13.292Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9a9f5a438223b25f94308c81","created_at":"2026-08-15T09:34:11.872Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-ecfb28b1b3804b86","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b3daa50a122d3bb8117126bdb73ab3ff","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:11.882Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9a9f5a438223b25f94308c81: start","job_status":"start","queue_duration_s":1.410208,"scheduling_latency_s":1.410223}1853gitlab # [ 311.796687] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:13.302Z","message":"No existing merge request to be cleaned up."}1854gitlab # [ 311.798294] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:13.310Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9a9f5a438223b25f94308c81","created_at":"2026-08-15T09:34:11.872Z","trace_propagation_headers":{"sentry-trace":"190ecac49ebf4e44a42d2ff02c087ee6-ecfb28b1b3804b86","baggage":"sentry-trace_id=190ecac49ebf4e44a42d2ff02c087ee6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b3daa50a122d3bb8117126bdb73ab3ff","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:11.882Z","job_size_bytes":2,"pid":1997,"sidekiq_tid":"map1","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9a9f5a438223b25f94308c81: done: 0.017963 sec","job_status":"done","queue_duration_s":1.410208,"scheduling_latency_s":1.410223,"redis_calls":10,"redis_duration_s":0.001302,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000743,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012946,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017963,"completed_at":"2026-08-15T09:34:13.310Z","load_balancing_strategy":"primary","db_duration_s":0.001248,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1855gitlab # [ 312.954263] gitaly[900]: time="2026-08-15T09:34:16.792Z" level=info msg="burden monitor stats" pid=9001856gitlab # [ 313.905939] runuser[2933]: pam_unix(runuser:session): session closed for user gitlab1857gitlab # [ 313.907168] setup-gitlab-start[2919]: + systemctl restart gitlab-sidekiq.service1858gitlab # [ 313.947467] systemd[1]: Stopping gitlab-sidekiq.service...1859gitlab # [ 313.950257] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:17.789Z","message":"Shutting down"}1860gitlab # [ 313.951937] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:17.789Z","message":"Scheduler exiting..."}1861gitlab # [ 313.953827] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:17.790Z","message":"Terminating quiet threads for default capsule"}1862gitlab # [ 313.955838] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:17.791Z","message":"Scheduler exiting..."}1863gitlab # [ 314.453197] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:18.292Z","message":"Pausing to allow jobs to finish..."}1864gitlab # [ 314.956825] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:18.795Z","message":"Bye!"}1865gitlab # [ 314.998942] sidekiq-cluster[1997]: {"severity":"INFO","time":"2026-08-15T09:34:18.838Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1997,"worker_id":"sidekiq_0","memwd_rss_bytes":974684160,"retry":0}1866gitlab # [ 316.521815] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1867gitlab # [ 316.522272] systemd[1]: Stopped gitlab-sidekiq.service.1868gitlab # [ 316.522508] systemd[1]: gitlab-sidekiq.service: Consumed 1min 54.528s CPU time over 3min 15.352s wall clock time, 958.3M memory peak, 4.5M read from disk.1869gitlab # [ 316.537267] systemd[1]: Started gitlab-sidekiq.service.1870gitlab # [ 316.546971] setup-gitlab-start[2919]: + mkdir -p /var/lib/secrets1871gitlab # [ 316.558408] setup-gitlab-start[2919]: + echo nixbot-test-token-of-20-chars1872gitlab # [ 316.561653] setup-gitlab-start[2919]: + chmod 644 /var/lib/secrets/gitlab-token1873gitlab # [ 316.564672] setup-gitlab-start[2919]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1874gitlab # [ 317.797935] gitaly[900]: time="2026-08-15T09:34:21.636Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M02CBCRHQSDE050FECM2WTGP error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T09:34:31.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T09:34:21.635" pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1875gitlab # [ 317.823015] gitaly[900]: time="2026-08-15T09:34:21.636Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M02CBCRHQSDE050FECM2WTGP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T09:34:31.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T09:34:21.635" grpc.time_ms=1.011 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1876gitlab # [ 318.098082] gitaly[900]: time="2026-08-15T09:34:21.937Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M02CBCRHQSDE050FECM2WTGP error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T09:34:31.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T09:34:21.937" pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1877gitlab # [ 318.123945] gitaly[900]: time="2026-08-15T09:34:21.937Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M02CBCRHQSDE050FECM2WTGP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T09:34:31.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T09:34:21.937" grpc.time_ms=0.612 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1878gitlab # [ 318.195683] gitaly[900]: time="2026-08-15T09:34:22.035Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M02CBCRHQSDE050FECM2WTGP diskcache=be4a761c-e560-4975-925a-ddc6e34a6c1c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-15T09:34:31.030" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T09:34:21.961" pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1879gitlab # [ 318.227946] gitaly[900]: time="2026-08-15T09:34:22.035Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=38 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1440 command.oublock=32 command.real_time_ms=50 command.spawn_token_fork_ms=25 command.system_time_ms=38 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CBCRHQSDE050FECM2WTGP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-15T09:34:31.030" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T09:34:21.961" grpc.time_ms=74.122 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1880gitlab # [ 318.265327] gitaly[900]: time="2026-08-15T09:34:22.089Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M02CBCRHQSDE050FECM2WTGP grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T09:34:32.007" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T09:34:22.087" pid=900 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1881gitlab # [ 318.288847] gitaly[900]: time="2026-08-15T09:34:22.089Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M02CBCRHQSDE050FECM2WTGP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T09:34:32.007" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T09:34:22.087" grpc.time_ms=1.36 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1882gitlab # [ 318.312100] gitaly[900]: time="2026-08-15T09:34:22.131Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=8 component=gitaly.UnaryServerInterceptor correlation_id=01M02CBCRHQSDE050FECM2WTGP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-15T09:34:32.032" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T09:34:22.112" grpc.time_ms=18.933 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1883gitlab # [ 318.435806] gitaly[900]: time="2026-08-15T09:34:22.275Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M02CBCRHQSDE050FECM2WTGP error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T09:34:32.194" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T09:34:22.274" pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1884gitlab # [ 318.467342] gitaly[900]: time="2026-08-15T09:34:22.275Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M02CBCRHQSDE050FECM2WTGP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T09:34:32.194" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T09:34:22.274" grpc.time_ms=0.529 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1885gitlab # [ 318.500520] gitaly[900]: time="2026-08-15T09:34:22.339Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M02CBCRHQSDE050FECM2WTGP diskcache=6599d60e-8071-4b6d-b9ce-16b3749ab47d grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-15T09:34:32.199" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T09:34:22.280" pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1886gitlab # [ 318.525278] gitaly[900]: time="2026-08-15T09:34:22.340Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=35 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1437 command.oublock=32 command.real_time_ms=39 command.spawn_token_fork_ms=5 command.system_time_ms=25 command.user_time_ms=10 component=gitaly.UnaryServerInterceptor correlation_id=01M02CBCRHQSDE050FECM2WTGP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-15T09:34:32.199" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T09:34:22.280" grpc.time_ms=60.094 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1887gitlab # [ 318.553650] gitaly[900]: time="2026-08-15T09:34:22.353Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M02CBCRHQSDE050FECM2WTGP grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T09:34:32.271" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T09:34:22.352" pid=900 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1888gitlab # [ 318.573013] gitaly[900]: time="2026-08-15T09:34:22.353Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M02CBCRHQSDE050FECM2WTGP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T09:34:32.271" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T09:34:22.352" grpc.time_ms=1.362 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1889gitlab # [ 318.591187] gitaly[900]: time="2026-08-15T09:34:22.378Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CBCRHQSDE050FECM2WTGP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-15T09:34:32.280" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T09:34:22.361" grpc.time_ms=17.138 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1890gitlab # [ 318.611492] gitaly[900]: time="2026-08-15T09:34:22.438Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M02CBCRHQSDE050FECM2WTGP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T09:34:32.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T09:34:22.437" grpc.time_ms=0.475 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1891gitlab # [ 318.626725] gitaly[900]: time="2026-08-15T09:34:22.446Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M02CBCRHQSDE050FECM2WTGP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-15T09:34:32.015" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T09:34:22.446" grpc.time_ms=0.536 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1892gitlab # [ 319.460398] gitaly[900]: time="2026-08-15T09:34:23.299Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M02CBCRHQSDE050FECM2WTGP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-15T09:34:33.201" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T09:34:23.281" grpc.time_ms=17.243 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1893gitlab # [ 320.083649] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:34:23 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 34871894gitlab # [ 320.090701] setup-gitlab-start[2919]: + mkdir -p /tmp/test-flake1895gitlab # [ 320.093797] setup-gitlab-start[2919]: + cd /tmp/test-flake1896gitlab # [ 320.096462] setup-gitlab-start[2919]: + git init -b master1897gitlab # [ 320.102413] setup-gitlab-start[3375]: Initialized empty Git repository in /tmp/test-flake/.git/1898gitlab # [ 320.106262] setup-gitlab-start[2919]: + git config user.name test1899gitlab # [ 320.108965] setup-gitlab-start[2919]: + git config user.email test@example.com1900gitlab # [ 320.111933] setup-gitlab-start[2919]: + cat1901gitlab # [ 320.113848] setup-gitlab-start[2919]: + git add flake.nix1902gitlab # [ 320.116131] setup-gitlab-start[2919]: + git commit -m 'initial commit'1903gitlab # [ 320.134506] setup-gitlab-start[3380]: [master (root-commit) e906b9a] initial commit1904gitlab # [ 320.135651] setup-gitlab-start[3380]: 1 file changed, 10 insertions(+)1905gitlab # [ 320.136762] setup-gitlab-start[3380]: create mode 100644 flake.nix1906gitlab # [ 320.137695] setup-gitlab-start[2919]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1907gitlab # [ 320.147642] setup-gitlab-start[2919]: + git push -u origin master1908gitlab # [ 320.227527] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:34:24 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 481909gitlab # [ 320.676117] gitaly[900]: time="2026-08-15T09:34:24.515Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M02CBGA45YTN7EGBN6CGQ764 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:34:24.496" grpc.time_ms=18.889 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1910gitlab # [ 320.689758] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:34:24 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 4501911gitlab # [ 321.115491] gitaly[900]: time="2026-08-15T09:34:24.954Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CBGS014N3S3QNN2N58H0B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-15T09:34:34.007" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T09:34:24.937" grpc.time_ms=17.249 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1912gitlab # [ 321.180296] gitaly[900]: time="2026-08-15T09:34:25.019Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M02CBGS014N3S3QNN2N58H0B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-15T09:34:55.001" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-15T09:34:25.001" grpc.time_ms=17.547 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1913gitlab # [ 321.258344] gitaly[900]: time="2026-08-15T09:34:25.097Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M02CBGS014N3S3QNN2N58H0B duration_ms=355ns method=POST pid=900 status=200 url="http://unix/api/v4/internal/allowed"1914gitlab # [ 321.296244] gitaly[900]: time="2026-08-15T09:34:25.135Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M02CBGS014N3S3QNN2N58H0B duration_ms=36ns method=POST pid=900 status=200 url="http://unix/api/v4/internal/pre_receive"1915gitlab # [ 321.309709] gitaly[900]: time="2026-08-15T09:34:25.136Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M02CBGS014N3S3QNN2N58H0B grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5316 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T09:34:24.739" grpc.time_ms=396.179 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1916gitlab # [ 321.392764] gitaly[900]: time="2026-08-15T09:34:25.232Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M02CBGS014N3S3QNN2N58H0B grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T09:34:25.229" grpc.time_ms=2.285 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1917gitlab # [ 321.448226] gitaly[900]: time="2026-08-15T09:34:25.287Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M02CBGS014N3S3QNN2N58H0B grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T09:34:25.286" grpc.time_ms=0.968 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1918gitlab # [ 321.493730] gitaly[900]: time="2026-08-15T09:34:25.333Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M02CBGS014N3S3QNN2N58H0B grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4787 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T09:34:25.332" grpc.time_ms=0.839 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1919gitlab # [ 321.685291] gitaly[900]: time="2026-08-15T09:34:25.523Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CBGS014N3S3QNN2N58H0B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-15T09:34:35.005" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T09:34:25.506" grpc.time_ms=16.96 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1920gitlab # [ 321.736254] gitaly[900]: time="2026-08-15T09:34:25.575Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=30 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1432 command.oublock=0 command.real_time_ms=34 command.spawn_token_fork_ms=4 command.system_time_ms=30 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CBGS014N3S3QNN2N58H0B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-15T09:34:35.037" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T09:34:25.537" grpc.time_ms=37.524 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1921gitlab # [ 321.776594] gitaly[900]: time="2026-08-15T09:34:25.596Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M02CBGS014N3S3QNN2N58H0B duration_ms=217ns method=POST pid=900 status=200 url="http://unix/api/v4/internal/post_receive"1922gitlab # [ 321.784345] gitaly[900]: time="2026-08-15T09:34:25.597Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M02CBGS014N3S3QNN2N58H0B grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4810 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T09:34:25.377" grpc.time_ms=219.846 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1923gitlab # [ 321.807247] gitaly[900]: time="2026-08-15T09:34:25.612Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M02CBGS014N3S3QNN2N58H0B diskcache=28cf122d-d587-41cf-8d78-02f5e6f46e19 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:34:24.623" pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1924gitlab # [ 321.827874] gitlab-workhorse[821]: time="2026-08-15T09:34:25Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521925gitlab # [ 321.831277] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:34:25 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 10691926gitlab # [ 321.836701] systemd[1]: Finished setup-gitlab.service.1927gitlab # [ 321.838602] setup-gitlab-start[3384]: To http://gitlab/root/test-flake.git1928gitlab # [ 321.840391] setup-gitlab-start[3384]: * [new branch] master -> master1929gitlab # [ 321.842089] setup-gitlab-start[3384]: branch 'master' set up to track 'origin/master'.1930gitlab # [ 321.843948] gitaly[900]: time="2026-08-15T09:34:25.613Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=348 command.inblock=8 command.majflt=0 command.maxrssanon_bytes=851968 command.minflt=13878 command.oublock=32 command.real_time_ms=979 command.spawn_token_fork_ms=2 command.system_time_ms=217 command.user_time_ms=131 component=gitaly.StreamServerInterceptor correlation_id=01M02CBGS014N3S3QNN2N58H0B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:34:24.623" grpc.time_ms=989.722 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1931gitlab # [ 321.865404] systemd[1]: Starting nixbot CI service...1932gitlab # [ 322.072689] sidekiq-cluster[3319]: {"severity":"INFO","time":"2026-08-15T09:34:25.882Z","message":"Starting cluster with 1 processes"}1933gitlab: (finished: waiting for unit setup-gitlab.service, in 323.53 seconds)1934gitlab: waiting for unit nixbot.service1935gitlab # [ 323.225907] nixbot[3476]: {"ts": "2026-08-15T09:34:27.064Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1936gitlab # [ 323.249879] nixbot[3476]: {"ts": "2026-08-15T09:34:27.089Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1937gitlab # [ 323.266996] nixbot[3476]: {"ts": "2026-08-15T09:34:27.106Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1938gitlab # [ 323.273836] nixbot[3476]: {"ts": "2026-08-15T09:34:27.111Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1939gitlab # [ 323.280616] nixbot[3476]: {"ts": "2026-08-15T09:34:27.115Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1940gitlab # [ 323.286877] nixbot[3476]: {"ts": "2026-08-15T09:34:27.120Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1941gitlab # [ 323.293657] nixbot[3476]: {"ts": "2026-08-15T09:34:27.125Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1942gitlab # [ 323.300344] nixbot[3476]: {"ts": "2026-08-15T09:34:27.128Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1943gitlab # [ 323.307166] nixbot[3476]: {"ts": "2026-08-15T09:34:27.132Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1944gitlab # [ 323.313545] nixbot[3476]: {"ts": "2026-08-15T09:34:27.135Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1945gitlab # [ 323.319826] nixbot[3476]: {"ts": "2026-08-15T09:34:27.139Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1946gitlab # [ 323.325907] nixbot[3476]: {"ts": "2026-08-15T09:34:27.145Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1947gitlab # [ 323.331631] nixbot[3476]: {"ts": "2026-08-15T09:34:27.148Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1948gitlab # [ 323.337617] nixbot[3476]: {"ts": "2026-08-15T09:34:27.150Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1949gitlab # [ 323.343137] nixbot[3476]: {"ts": "2026-08-15T09:34:27.153Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1950gitlab # [ 323.348492] nixbot[3476]: {"ts": "2026-08-15T09:34:27.155Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1951gitlab # [ 323.352765] nixbot[3476]: {"ts": "2026-08-15T09:34:27.156Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1952gitlab # [ 323.356823] nixbot[3476]: {"ts": "2026-08-15T09:34:27.158Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1953gitlab # [ 323.364629] nixbot[3476]: {"ts": "2026-08-15T09:34:27.162Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1954gitlab # [ 323.366703] nixbot[3476]: {"ts": "2026-08-15T09:34:27.163Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1955gitlab # [ 323.369204] nixbot[3476]: {"ts": "2026-08-15T09:34:27.165Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1956gitlab # [ 323.371580] nixbot[3476]: {"ts": "2026-08-15T09:34:27.170Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1957gitlab # [ 323.374154] nixbot[3476]: {"ts": "2026-08-15T09:34:27.172Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1958gitlab # [ 323.376219] nixbot[3476]: {"ts": "2026-08-15T09:34:27.173Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1959gitlab # [ 323.378167] nixbot[3476]: {"ts": "2026-08-15T09:34:27.174Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1960gitlab # [ 323.800107] nixbot[3476]: INFO: Started server process [3476]1961gitlab # [ 323.802835] nixbot[3476]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1962gitlab # [ 323.851676] nixbot[3476]: INFO: ::ffff:127.0.0.1:52252 - "GET /health HTTP/1.1" 200 OK1963gitlab # [ 323.860318] systemd[1]: Started nixbot CI service.1964gitlab # [ 323.862470] systemd[1]: Reached target Multi-User System.1965gitlab # [ 323.868447] systemd[1]: Startup finished in 821ms (kernel) + 5.192s (initrd) + 5min 17.854s (userspace) = 5min 23.868s.1966gitlab: (finished: waiting for unit nixbot.service, in 1.10 seconds)1967gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1968gitlab # [ 324.209375] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:34:28 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 3581969gitlab # [ 324.220608] nixbot[3476]: {"ts": "2026-08-15T09:34:28.050Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1970gitlab # [ 324.250418] nixbot[3476]: INFO: ::ffff:127.0.0.1:52268 - "GET /health HTTP/1.1" 200 OK1971gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.06 seconds)1972subtest: project discovered and webhook registered1973gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1974gitlab # [ 324.255576] nixbot[3476]: {"ts": "2026-08-15T09:34:28.094Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1975gitlab # [ 324.411011] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:34:28 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1471976gitlab # [ 324.417212] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:34:28 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 1051977gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.17 seconds)1978gitlab # [ 324.424066] nixbot[3476]: {"ts": "2026-08-15T09:34:28.252Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1979gitlab # [ 324.428648] nixbot[3476]: {"ts": "2026-08-15T09:34:28.255Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1980gitlab # [ 324.704542] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:34:28 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 2841981gitlab # [ 324.706968] nixbot[3476]: {"ts": "2026-08-15T09:34:28.546Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1982gitlab # [ 325.022848] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:34:28 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 2971983gitlab # [ 325.029295] nixbot[3476]: {"ts": "2026-08-15T09:34:28.864Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1984gitlab # [ 325.186997] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:34:29 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 1461985gitlab # [ 325.189538] nixbot[3476]: {"ts": "2026-08-15T09:34:29.028Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1986gitlab # [ 325.330140] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:34:29 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 1311987gitlab # [ 325.338014] nixbot[3476]: {"ts": "2026-08-15T09:34:29.169Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1988gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1989gitlab # [ 325.443304] gitaly[900]: time="2026-08-15T09:34:29.281Z" level=info msg="finished unary call with code OK" catfile.duration_ms=6 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=6 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=3 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CBN9VN1E6TSQVB45WXPSX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-08-15T09:34:59.252" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T09:34:29.253" grpc.time_ms=27.512 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1990gitlab # [ 325.509678] gitaly[900]: time="2026-08-15T09:34:29.349Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CBN9VN1E6TSQVB45WXPSX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T09:34:59.346" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:34:29.347" grpc.time_ms=1.414 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1991gitlab # [ 325.549925] gitaly[900]: time="2026-08-15T09:34:29.389Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M02CBN9VN1E6TSQVB45WXPSX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-15T09:34:39.005" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:34:29.376" grpc.time_ms=12.747 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1992gitlab # [ 325.593682] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:34:29 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 1031993gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.18 seconds)1994(finished: subtest: project discovered and webhook registered, in 1.35 seconds)1995subtest: push delivers the webhook1996gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1997gitlab # [ 325.606296] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:34:29 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 2651998gitlab # [ 325.614439] nixbot[3476]: {"ts": "2026-08-15T09:34:29.447Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1999gitlab # [ 325.708691] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:34:29 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 452000gitlab # [ 325.716656] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:34:29 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1022001gitlab # [ 325.724422] nixbot[3476]: {"ts": "2026-08-15T09:34:29.560Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}2002gitlab # [ 325.732676] nixbot[3476]: {"ts": "2026-08-15T09:34:29.566Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}2003gitlab # [ 325.892891] gitaly[900]: time="2026-08-15T09:34:29.732Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=4 command.system_time_ms=3 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M02CBNR1SD49M0C0QQ2W1105 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:34:29.719" grpc.time_ms=12.942 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc2004gitlab # [ 325.914803] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:34:29 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 992005gitlab # [ 325.918472] gitaly[900]: time="2026-08-15T09:34:29.757Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M02CBNNMYD04SEG9N59VJP9C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=246 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:34:29.735" grpc.time_ms=22.261 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root2006gitlab # [ 325.938160] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:34:29 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 2212007gitlab # Enumerating objects: 5, done.2008gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.2009gitlab # Delta compression using up to 4 threads2010gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.2011gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 274 bytes | 274.00 KiB/s, done.2012gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)2013gitlab # [ 326.099627] gitaly[900]: time="2026-08-15T09:34:29.939Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M02CBNVAW5PSQDH1G4NDYW8Q grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:34:29.925" pid=900 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc2014gitlab # [ 326.131920] gitaly[900]: time="2026-08-15T09:34:29.939Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CBNVAW5PSQDH1G4NDYW8Q grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:34:29.925" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc2015gitlab # [ 326.161843] gitlab-workhorse[821]: time="2026-08-15T09:34:29Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1132016gitlab # [ 326.165787] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:34:29 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 2012017gitlab # [ 326.169841] gitaly[900]: time="2026-08-15T09:34:29.939Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CBNVAW5PSQDH1G4NDYW8Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:34:29.925" grpc.time_ms=13.943 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc2018gitlab # [ 326.213571] gitaly[900]: time="2026-08-15T09:34:30.053Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M02CBP1XV0JJKFBCVC9PWMTB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:34:30.033" pid=900 remote_ip="2001:db8:1::1" request_sha=5f61f8a2821bf740c7267be96c9e66a9e3cae9ce response_bytes=223 span.kind=server system=grpc2019gitlab # [ 326.228200] gitaly[900]: time="2026-08-15T09:34:30.053Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1134 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=5 command.system_time_ms=12 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M02CBP1XV0JJKFBCVC9PWMTB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:34:30.033" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc2020gitlab # [ 326.246238] gitlab-workhorse[821]: time="2026-08-15T09:34:30Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2232021gitlab # [ 326.248518] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:34:30 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 1042022gitlab # [ 326.250803] gitaly[900]: time="2026-08-15T09:34:30.053Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1134 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=5 command.system_time_ms=12 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M02CBP1XV0JJKFBCVC9PWMTB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:34:30.033" grpc.time_ms=20.299 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc2023gitlab # [ 326.275527] gitaly[900]: time="2026-08-15T09:34:30.115Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=302 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=3 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M02CBNX3C2B3ZSXSHA0B8DDC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-15T09:35:00.004" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-15T09:34:30.104" grpc.time_ms=10.115 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2024gitlab # [ 326.304550] gitaly[900]: time="2026-08-15T09:34:30.139Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M02CBNX3C2B3ZSXSHA0B8DDC duration_ms=143ns method=POST pid=900 status=200 url="http://unix/api/v4/internal/allowed"2025gitlab # [ 326.329679] gitaly[900]: time="2026-08-15T09:34:30.169Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M02CBP6XRC8A63PSJZTW44VR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:34:30.158" grpc.time_ms=10.187 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc2026gitlab # [ 326.354425] gitaly[900]: time="2026-08-15T09:34:30.173Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M02CBNX3C2B3ZSXSHA0B8DDC duration_ms=33ns method=POST pid=900 status=200 url="http://unix/api/v4/internal/pre_receive"2027gitlab # [ 326.359517] gitaly[900]: time="2026-08-15T09:34:30.173Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M02CBNX3C2B3ZSXSHA0B8DDC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5316 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T09:34:29.994" grpc.time_ms=178.825 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root2028gitlab # [ 326.377220] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:34:30 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 592029gitlab # [ 326.380700] gitaly[900]: time="2026-08-15T09:34:30.202Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M02CBNX3C2B3ZSXSHA0B8DDC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T09:34:30.202" grpc.time_ms=0.738 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root2030gitlab # [ 326.397800] gitaly[900]: time="2026-08-15T09:34:30.234Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M02CBNX3C2B3ZSXSHA0B8DDC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T09:34:30.233" grpc.time_ms=0.61 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root2031gitlab # [ 326.412656] gitaly[900]: time="2026-08-15T09:34:30.238Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M02CBP8WEC1CXE02PEYTT53N grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:34:30.228" pid=900 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2032gitlab # [ 326.426249] gitlab-workhorse[821]: time="2026-08-15T09:34:30Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672033gitlab # [ 326.428581] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:34:30 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 662034gitlab # [ 326.430915] gitaly[900]: time="2026-08-15T09:34:30.238Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CBP8WEC1CXE02PEYTT53N grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:34:30.228" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc2035gitlab # [ 326.446979] gitaly[900]: time="2026-08-15T09:34:30.239Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CBP8WEC1CXE02PEYTT53N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:34:30.228" grpc.time_ms=10.561 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc2036gitlab # [ 326.463359] gitaly[900]: time="2026-08-15T09:34:30.266Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M02CBNX3C2B3ZSXSHA0B8DDC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4787 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T09:34:30.266" grpc.time_ms=0.392 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root2037gitlab # [ 326.519495] gitaly[900]: time="2026-08-15T09:34:30.359Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M02CBNX3C2B3ZSXSHA0B8DDC duration_ms=71ns method=POST pid=900 status=200 url="http://unix/api/v4/internal/post_receive"2038gitlab # [ 326.525056] gitaly[900]: time="2026-08-15T09:34:30.359Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M02CBNX3C2B3ZSXSHA0B8DDC grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4810 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T09:34:30.286" grpc.time_ms=72.657 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root2039gitlab # To http://gitlab/root/test-flake.git2040gitlab # [ 326.545416] gitaly[900]: time="2026-08-15T09:34:30.367Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M02CBPCZSDA8PJRH4B0CRPBF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:34:30.357" grpc.time_ms=10.482 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc2041gitlab # e906b9a..d0eb289 [ 326.567252] gitaly[900]: time="2026-08-15T09:34:30.368Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M02CBNX3C2B3ZSXSHA0B8DDC diskcache=20e71ac2-fbfc-4402-8acf-d59964d953ba grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:34:29.873" pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root2042gitlab # master -> master[ 326.581574] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:34:30 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 642043gitlab # [ 326.584638] gitlab-workhorse[821]: time="2026-08-15T09:34:30Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=522044gitlab # [ 326.587240] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:34:30 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 5722045gitlab # 2046gitlab # [ 326.590074] gitaly[900]: time="2026-08-15T09:34:30.368Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=157 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=819200 command.minflt=12759 command.oublock=32 command.real_time_ms=482 command.spawn_token_fork_ms=2 command.system_time_ms=106 command.user_time_ms=51 component=gitaly.StreamServerInterceptor correlation_id=01M02CBNX3C2B3ZSXSHA0B8DDC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=606 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=58 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:34:29.873" grpc.time_ms=494.37 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root2047gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 1.02 seconds)2048gitlab # [ 326.609182] gitaly[900]: time="2026-08-15T09:34:30.436Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M02CBPF2BWD33ZEXC6WFG9RR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:34:30.422" pid=900 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=214 span.kind=server system=grpc2049gitlab: must succeed: git -C /tmp/test-flake rev-parse master2050gitlab # [ 326.621720] gitlab-workhorse[821]: time="2026-08-15T09:34:30Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2142051gitlab # [ 326.623789] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:34:30 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 214 "" "git/2.55.0" 672052gitlab # [ 326.626258] gitaly[900]: time="2026-08-15T09:34:30.437Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1101 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M02CBPF2BWD33ZEXC6WFG9RR grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:34:30.422" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc2053gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.02 seconds)2054gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2055gitlab # [ 326.641726] gitaly[900]: time="2026-08-15T09:34:30.437Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1101 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M02CBPF2BWD33ZEXC6WFG9RR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:34:30.422" grpc.time_ms=14.823 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc2056gitlab # [ 326.692036] gitaly[900]: time="2026-08-15T09:34:30.529Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CBPJ74XHM99VDN0EHZ2K4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T09:35:00.427" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:34:30.528" grpc.time_ms=0.648 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2057gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.10 seconds)2058gitlab # [ 326.727011] gitaly[900]: time="2026-08-15T09:34:30.566Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=592 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M02CBPJ74XHM99VDN0EHZ2K4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-15T09:35:00.451" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T09:34:30.552" grpc.time_ms=14.022 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2059gitlab # [ 326.741719] nixbot[3476]: INFO: ::ffff:127.0.0.1:52276 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2060gitlab # [ 326.759263] gitaly[900]: time="2026-08-15T09:34:30.598Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M02CBPJ74XHM99VDN0EHZ2K4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T09:34:40.160" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T09:34:30.591" grpc.time_ms=7.34 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2061gitlab # [ 326.786914] gitaly[900]: time="2026-08-15T09:34:30.626Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01M02CBPJ74XHM99VDN0EHZ2K4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T09:34:40.184" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T09:34:30.615" grpc.time_ms=11.227 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2062gitlab # [ 326.898933] gitaly[900]: time="2026-08-15T09:34:30.738Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M02CBPJ74XHM99VDN0EHZ2K4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-15T09:34:40.106" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T09:34:30.737" grpc.time_ms=0.655 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2063gitlab # [ 326.932191] gitaly[900]: time="2026-08-15T09:34:30.767Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=5 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M02CBPJ74XHM99VDN0EHZ2K4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-15T09:34:40.120" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T09:34:30.750" grpc.time_ms=16.804 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2064gitlab # [ 326.999245] gitaly[900]: time="2026-08-15T09:34:30.838Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M02CBPJ74XHM99VDN0EHZ2K4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T09:34:30.837" grpc.time_ms=1.176 pid=900 span.kind=server system=grpc2065gitlab # [ 327.053220] gitaly[900]: time="2026-08-15T09:34:30.892Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M02CBPJ74XHM99VDN0EHZ2K4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4156 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T09:34:30.891" grpc.time_ms=0.817 pid=900 span.kind=server system=grpc2066gitlab # [ 327.081974] gitaly[900]: time="2026-08-15T09:34:30.905Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M02CBPJ74XHM99VDN0EHZ2K4 diskcache=7921816e-f004-4412-ba35-300a98be24e1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-15T09:34:40.141" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T09:34:30.771" pid=900 ref=refs/keep-around/e906b9a8d4041fc27a4d455c0fa988f8d6ec5d83 remote_ip="2001:db8:1::1" revision=e906b9a8d4041fc27a4d455c0fa988f8d6ec5d83 span.kind=server system=grpc username=root2067gitlab # [ 327.107504] gitaly[900]: time="2026-08-15T09:34:30.906Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=129 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5264 command.oublock=8 command.real_time_ms=126 command.spawn_token_fork_ms=2 command.system_time_ms=68 command.user_time_ms=61 component=gitaly.UnaryServerInterceptor correlation_id=01M02CBPJ74XHM99VDN0EHZ2K4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-15T09:34:40.141" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T09:34:30.771" grpc.time_ms=134.581 pid=900 ref=refs/keep-around/e906b9a8d4041fc27a4d455c0fa988f8d6ec5d83 remote_ip="2001:db8:1::1" revision=e906b9a8d4041fc27a4d455c0fa988f8d6ec5d83 span.kind=server system=grpc username=root2068gitlab # [ 327.133330] gitaly[900]: time="2026-08-15T09:34:30.912Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CBPJ74XHM99VDN0EHZ2K4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T09:35:00.811" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:34:30.911" grpc.time_ms=0.714 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2069gitlab # [ 327.304386] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:34:31 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e906b9a8d4041fc27a4d455c0fa988f8d6ec5d83 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 6712070gitlab # [ 327.312476] nixbot[3476]: {"ts": "2026-08-15T09:34:31.145Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/e906b9a8d4041fc27a4d455c0fa988f8d6ec5d83 \"HTTP/1.1 201 Created\""}2071gitlab # [ 327.321480] nixbot[3476]: {"ts": "2026-08-15T09:34:31.154Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-e906b9a8d404-0"}2072gitlab # [ 327.412751] systemd[1]: Started Nix Daemon.2073gitlab # [ 327.535256] nix-daemon[3683]: accepted connection from pid 3677, user nixbot2074gitlab # [ 327.675415] nix-daemon[3683]: accepted connection from pid 3690, user nixbot2075gitlab # [ 327.702422] nixbot[3476]: {"ts": "2026-08-15T09:34:31.541Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-e906b9a8d404-0", "argv0": "bwrap"}2076gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2077gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.06 seconds)2078gitlab # [ 327.798911] nixbot[3476]: INFO: ::ffff:127.0.0.1:52282 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2079gitlab # [ 327.917881] nix-daemon[3683]: accepted connection from pid 3703, user nixbot2080gitlab # [ 327.996386] nix-daemon[3683]: accepted connection from pid 3713, user nixbot2081gitlab # [ 328.012968] nix-daemon[3683]: accepted connection from pid 3703, user nixbot2082gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2083gitlab # [ 328.852226] nixbot[3476]: INFO: ::ffff:127.0.0.1:52296 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2084gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.06 seconds)2085gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2086gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2087gitlab # [ 329.909117] nixbot[3476]: INFO: ::ffff:127.0.0.1:52298 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2088gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2089gitlab # [ 330.962292] nixbot[3476]: INFO: ::ffff:127.0.0.1:33710 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2090gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2091gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2092gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2093gitlab # [ 332.016277] nixbot[3476]: INFO: ::ffff:127.0.0.1:33718 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2094gitlab # [ 332.581816] gitaly[900]: time="2026-08-15T09:34:36.420Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CBW4FS2EBFK8P5MMRHAD3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T09:35:06.318" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:34:36.419" grpc.time_ms=0.946 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2095gitlab # [ 332.668342] gitaly[900]: time="2026-08-15T09:34:36.507Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M02CBW4FS2EBFK8P5MMRHAD3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T09:34:46.061" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T09:34:36.492" grpc.time_ms=15.267 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2096gitlab # [ 332.784644] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:34:36 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e906b9a8d4041fc27a4d455c0fa988f8d6ec5d83 HTTP/1.1" 201 670 "" "python-httpx/0.28.1" 4472097gitlab # [ 332.790882] nixbot[3476]: {"ts": "2026-08-15T09:34:36.625Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/e906b9a8d4041fc27a4d455c0fa988f8d6ec5d83 \"HTTP/1.1 201 Created\""}2098gitlab # [ 332.886054] gitaly[900]: time="2026-08-15T09:34:36.725Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CBWJTSA55FYDKDHZ1C4TQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T09:35:06.623" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:34:36.724" grpc.time_ms=0.961 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2099gitlab # [ 332.935288] gitaly[900]: time="2026-08-15T09:34:36.774Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M02CBWJTSA55FYDKDHZ1C4TQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T09:34:46.134" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T09:34:36.764" grpc.time_ms=9.543 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2100gitlab # [ 332.999143] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:34:36 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e906b9a8d4041fc27a4d455c0fa988f8d6ec5d83 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2032101gitlab # [ 333.003108] nixbot[3476]: {"ts": "2026-08-15T09:34:36.840Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/e906b9a8d4041fc27a4d455c0fa988f8d6ec5d83 \"HTTP/1.1 201 Created\""}2102gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2103gitlab # [ 333.047782] nixbot[3476]: INFO: ::ffff:127.0.0.1:33724 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2104gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.04 seconds)2105gitlab # [ 333.132912] gitaly[900]: time="2026-08-15T09:34:36.972Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CBWSWGCWXXB3MW723FGEH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T09:35:06.070" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:34:36.970" grpc.time_ms=1.204 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2106gitlab # [ 333.356685] gitaly[900]: time="2026-08-15T09:34:37.196Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M02CBWSWGCWXXB3MW723FGEH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T09:34:47.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T09:34:37.180" grpc.time_ms=15.733 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2107gitlab # [ 333.531437] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:34:37 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e906b9a8d4041fc27a4d455c0fa988f8d6ec5d83 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 5102108gitlab # [ 333.535267] nixbot[3476]: {"ts": "2026-08-15T09:34:37.373Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/e906b9a8d4041fc27a4d455c0fa988f8d6ec5d83 \"HTTP/1.1 201 Created\""}2109gitlab # [ 333.692671] nix-daemon[3683]: accepted connection from pid 3753, user nixbot2110gitlab # [ 333.887295] gitaly[900]: time="2026-08-15T09:34:37.725Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M02CBXHBF9FB0NVKC4WMGWRW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:34:37.708" grpc.time_ms=16.891 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc2111gitlab # [ 333.919199] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:34:37 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1152112gitlab # [ 334.014841] gitaly[900]: time="2026-08-15T09:34:37.854Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M02CBXN2VBD644S2G7M2A7F9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:34:37.835" pid=900 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2113gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2114gitlab # [ 334.039480] gitaly[900]: time="2026-08-15T09:34:37.854Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CBXN2VBD644S2G7M2A7F9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:34:37.835" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc2115gitlab # [ 334.069912] gitlab-workhorse[821]: time="2026-08-15T09:34:37Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672116gitlab # [ 334.073598] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:34:37 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1252117gitlab # [ 334.077174] gitaly[900]: time="2026-08-15T09:34:37.855Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CBXN2VBD644S2G7M2A7F9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:34:37.835" grpc.time_ms=19.168 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc2118gitlab # [ 334.117064] nixbot[3476]: INFO: ::ffff:127.0.0.1:33726 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2119gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.07 seconds)2120gitlab # [ 334.155247] gitaly[900]: time="2026-08-15T09:34:37.994Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M02CBXS3DWBSDX1KAAT31NZZ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:34:37.971" pid=900 remote_ip="2001:db8:1::1" request_sha=bf34c700e0a54b5f8afd419e187a5348b15a978a response_bytes=337 span.kind=server system=grpc2121gitlab # [ 334.176635] gitaly[900]: time="2026-08-15T09:34:37.995Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1128 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=1 command.system_time_ms=13 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M02CBXS3DWBSDX1KAAT31NZZ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:34:37.971" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc2122gitlab # [ 334.199494] gitlab-workhorse[821]: time="2026-08-15T09:34:37Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3372123gitlab # [ 334.202531] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:34:37 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 337 "" "git/2.55.0" 1372124gitlab # [ 334.205525] gitaly[900]: time="2026-08-15T09:34:37.995Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1128 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=1 command.system_time_ms=13 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M02CBXS3DWBSDX1KAAT31NZZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:34:37.971" grpc.time_ms=24.222 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc2125gitlab # [ 334.297707] nix-daemon[3683]: accepted connection from pid 3786, user nixbot2126gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2127gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2128gitlab # [ 335.179776] nixbot[3476]: INFO: ::ffff:127.0.0.1:33738 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2129gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2130gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2131gitlab # [ 336.231637] nixbot[3476]: INFO: ::ffff:127.0.0.1:33748 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2132gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2133gitlab # [ 337.284759] nixbot[3476]: INFO: ::ffff:127.0.0.1:33762 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2134gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.06 seconds)2135gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2136gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2137gitlab # [ 338.339899] nixbot[3476]: INFO: ::ffff:127.0.0.1:33778 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2138gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2139gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2140gitlab # [ 339.393117] nixbot[3476]: INFO: ::ffff:127.0.0.1:33780 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2141gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2142gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2143gitlab # [ 340.446154] nixbot[3476]: INFO: ::ffff:127.0.0.1:33790 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2144gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2145gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2146gitlab # [ 341.498413] nixbot[3476]: INFO: ::ffff:127.0.0.1:34362 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2147gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2148gitlab # [ 342.550050] nixbot[3476]: INFO: ::ffff:127.0.0.1:34374 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2149gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2150gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2151gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2152gitlab # [ 343.604810] nixbot[3476]: INFO: ::ffff:127.0.0.1:34382 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2153gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2154gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2155gitlab # [ 344.657819] nixbot[3476]: INFO: ::ffff:127.0.0.1:34392 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2156gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2157gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2158gitlab # [ 345.712468] nixbot[3476]: INFO: ::ffff:127.0.0.1:34396 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2159gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2160gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2161gitlab # [ 346.764689] nixbot[3476]: INFO: ::ffff:127.0.0.1:34408 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2162gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2163gitlab # [ 347.816668] nixbot[3476]: INFO: ::ffff:127.0.0.1:34410 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2164gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.06 seconds)2165gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2166gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2167gitlab # [ 348.872500] nixbot[3476]: INFO: ::ffff:127.0.0.1:34414 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2168gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2169gitlab # [ 349.923983] nixbot[3476]: INFO: ::ffff:127.0.0.1:34416 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2170gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2171gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2172gitlab # [ 350.978941] nixbot[3476]: INFO: ::ffff:127.0.0.1:51380 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2173gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2174gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2175gitlab # [ 352.034725] nixbot[3476]: INFO: ::ffff:127.0.0.1:51386 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2176gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.06 seconds)2177gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2178gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2179gitlab # [ 353.089663] nixbot[3476]: INFO: ::ffff:127.0.0.1:51390 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2180gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2181gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2182gitlab # [ 354.142470] nixbot[3476]: INFO: ::ffff:127.0.0.1:51396 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2183gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2184gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2185gitlab # [ 355.194409] nixbot[3476]: INFO: ::ffff:127.0.0.1:51412 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2186gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2187gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2188gitlab # [ 356.246539] nixbot[3476]: INFO: ::ffff:127.0.0.1:51418 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2189gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2190gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2191gitlab # [ 357.299449] nixbot[3476]: INFO: ::ffff:127.0.0.1:51430 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2192gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2193gitlab # [ 358.337161] nixbot[3476]: INFO: ::ffff:127.0.0.1:51438 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2194gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.04 seconds)2195gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2196gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2197gitlab # [ 359.390652] nixbot[3476]: INFO: ::ffff:127.0.0.1:51442 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2198gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2199gitlab # [ 360.442029] nixbot[3476]: INFO: ::ffff:127.0.0.1:51454 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2200gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2201gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2202gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2203gitlab # [ 361.495989] nixbot[3476]: INFO: ::ffff:127.0.0.1:57452 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2204gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2205gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2206gitlab # [ 362.547375] nixbot[3476]: INFO: ::ffff:127.0.0.1:57454 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2207gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2208gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2209gitlab # [ 363.598470] nixbot[3476]: INFO: ::ffff:127.0.0.1:57470 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2210gitlab # [ 363.805976] sidekiq-cluster[3484]: 2026-08-15T09:35:07.644Z pid=3484 tid=ylw INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>3484, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>432324608}2211gitlab # [ 364.142844] sidekiq-cluster[3484]: W, [2026-08-15T09:35:07.982260 #3484] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.2212gitlab # [ 364.207777] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:35:08.047Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}2213gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2214gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2215gitlab # [ 364.650110] nixbot[3476]: INFO: ::ffff:127.0.0.1:57476 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2216gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2217gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2218gitlab # [ 365.702993] nixbot[3476]: INFO: ::ffff:127.0.0.1:57482 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2219gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2220gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2221gitlab # [ 366.755894] nixbot[3476]: INFO: ::ffff:127.0.0.1:57494 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2222gitlab # [ 367.669360] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:35:11.507Z","message":"GitLab reliable fetch activated!"}2223gitlab # [ 367.669779] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:35:11.507Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2224gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2225gitlab # [ 367.805750] nixbot[3476]: INFO: ::ffff:127.0.0.1:57510 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2226gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2227gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2228gitlab # [ 368.860451] nixbot[3476]: INFO: ::ffff:127.0.0.1:57520 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2229gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2230gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2231gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2232gitlab # [ 369.915785] nixbot[3476]: INFO: ::ffff:127.0.0.1:57524 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2233gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2234gitlab # [ 370.968444] nixbot[3476]: INFO: ::ffff:127.0.0.1:33994 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2235gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2236gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2237gitlab # [ 372.006514] nixbot[3476]: INFO: ::ffff:127.0.0.1:34006 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2238gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.04 seconds)2239gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2240gitlab # [ 373.059873] nixbot[3476]: INFO: ::ffff:127.0.0.1:34018 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2241gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2242gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2243gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2244gitlab # [ 374.114492] nixbot[3476]: INFO: ::ffff:127.0.0.1:34024 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2245gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2246gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2247gitlab # [ 375.166884] nixbot[3476]: INFO: ::ffff:127.0.0.1:34028 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2248gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2249gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2250gitlab # [ 376.218877] nixbot[3476]: INFO: ::ffff:127.0.0.1:34034 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2251gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2252gitlab # [ 377.271140] nixbot[3476]: INFO: ::ffff:127.0.0.1:34042 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2253gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2254gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2255gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2256gitlab # [ 378.326356] nixbot[3476]: INFO: ::ffff:127.0.0.1:34048 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2257gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2258gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2259gitlab # [ 379.378081] nixbot[3476]: INFO: ::ffff:127.0.0.1:34052 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2260gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2261gitlab # [ 380.430887] nixbot[3476]: INFO: ::ffff:127.0.0.1:34054 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2262gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.06 seconds)2263gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2264gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2265gitlab # [ 381.486222] nixbot[3476]: INFO: ::ffff:127.0.0.1:49644 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2266gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2267gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2268gitlab # [ 382.539335] nixbot[3476]: INFO: ::ffff:127.0.0.1:49648 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2269gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2270gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2271gitlab # [ 383.592415] nixbot[3476]: INFO: ::ffff:127.0.0.1:49654 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2272gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2273gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2274gitlab # [ 384.645105] nixbot[3476]: INFO: ::ffff:127.0.0.1:49670 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2275gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2276gitlab # [ 385.698016] nixbot[3476]: INFO: ::ffff:127.0.0.1:49672 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2277gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2278gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2279gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2280gitlab # [ 386.752599] nixbot[3476]: INFO: ::ffff:127.0.0.1:49678 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2281gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2282gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2283gitlab # [ 387.805462] nixbot[3476]: INFO: ::ffff:127.0.0.1:49686 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2284gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2285gitlab # [ 388.859244] nixbot[3476]: INFO: ::ffff:127.0.0.1:49694 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2286gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.06 seconds)2287gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2288gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2289gitlab # [ 389.914668] nixbot[3476]: INFO: ::ffff:127.0.0.1:49702 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2290gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2291gitlab # [ 390.967079] nixbot[3476]: INFO: ::ffff:127.0.0.1:60452 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2292gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.06 seconds)2293gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2294gitlab # [ 392.022306] nixbot[3476]: INFO: ::ffff:127.0.0.1:60462 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2295gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2296gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2297gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2298gitlab # [ 393.076420] nixbot[3476]: INFO: ::ffff:127.0.0.1:60468 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2299gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2300gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2301gitlab # [ 394.127722] nixbot[3476]: INFO: ::ffff:127.0.0.1:60480 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2302gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2303gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2304gitlab # [ 395.180103] nixbot[3476]: INFO: ::ffff:127.0.0.1:60484 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2305gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2306gitlab # [ 396.232878] nixbot[3476]: INFO: ::ffff:127.0.0.1:60498 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2307gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.06 seconds)2308gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2309gitlab # [ 397.287898] nixbot[3476]: INFO: ::ffff:127.0.0.1:60512 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2310gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2311gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2312gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2313gitlab # [ 398.344189] nixbot[3476]: INFO: ::ffff:127.0.0.1:60528 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2314gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2315gitlab # [ 399.395989] nixbot[3476]: INFO: ::ffff:127.0.0.1:60530 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2316gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2317gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2318gitlab # [ 400.452387] nixbot[3476]: INFO: ::ffff:127.0.0.1:60536 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2319gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.06 seconds)2320gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2321gitlab # [ 401.507206] nixbot[3476]: INFO: ::ffff:127.0.0.1:54788 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2322gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2323gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2324gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2325gitlab # [ 402.561442] nixbot[3476]: INFO: ::ffff:127.0.0.1:54802 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2326gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2327gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2328gitlab # [ 403.613861] nixbot[3476]: INFO: ::ffff:127.0.0.1:54818 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2329gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2330gitlab # [ 404.666079] nixbot[3476]: INFO: ::ffff:127.0.0.1:54822 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2331gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2332gitlab # [ 405.369205] postgres[4015]: [4015] ERROR: relation "table_without_models" does not exist2333gitlab # [ 405.369547] postgres[4015]: [4015] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')2334gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2335gitlab # [ 405.721644] nixbot[3476]: INFO: ::ffff:127.0.0.1:54824 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2336gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.06 seconds)2337gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2338gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2339gitlab # [ 406.776386] nixbot[3476]: INFO: ::ffff:127.0.0.1:54828 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2340gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2341gitlab # [ 407.827598] nixbot[3476]: INFO: ::ffff:127.0.0.1:54832 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2342gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2343gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2344gitlab # [ 408.882007] nixbot[3476]: INFO: ::ffff:127.0.0.1:54846 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2345gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2346gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2347gitlab # [ 409.936318] nixbot[3476]: INFO: ::ffff:127.0.0.1:54850 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2348gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2349gitlab # [ 410.231050] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:35:54.070Z","message":"Booted Rails 7.2.3.1 application in production environment"}2350gitlab # [ 410.234263] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:35:54.073Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}2351gitlab # [ 410.241497] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:35:54.073Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}2352gitlab # [ 410.247050] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:35:54.073Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}2353gitlab # [ 410.253331] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:35:54.077Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}2354gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2355gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2356gitlab # [ 410.992322] nixbot[3476]: INFO: ::ffff:127.0.0.1:59968 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2357gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2358gitlab # [ 412.044699] nixbot[3476]: INFO: ::ffff:127.0.0.1:59982 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2359gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2360gitlab # [ 412.900630] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:35:56.738Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"50abfecedc0c00ded4597b1d","created_at":"2026-08-15T09:34:22.152Z","trace_propagation_headers":{"sentry-trace":"a4e0b95ca73b4f929cb73f9a1f002f88-71dc7a86951a47d1","baggage":"sentry-trace_id=a4e0b95ca73b4f929cb73f9a1f002f88,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M02CBCRHQSDE050FECM2WTGP","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:22.225Z","job_size_bytes":2,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-50abfecedc0c00ded4597b1d: start","job_status":"start","queue_duration_s":94.512762,"scheduling_latency_s":94.512863}2361gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2362gitlab # [ 413.097499] nixbot[3476]: INFO: ::ffff:127.0.0.1:59988 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2363gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2364gitlab # [ 413.177028] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:35:57.015Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"50abfecedc0c00ded4597b1d","created_at":"2026-08-15T09:34:22.152Z","trace_propagation_headers":{"sentry-trace":"a4e0b95ca73b4f929cb73f9a1f002f88-71dc7a86951a47d1","baggage":"sentry-trace_id=a4e0b95ca73b4f929cb73f9a1f002f88,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M02CBCRHQSDE050FECM2WTGP","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:22.225Z","job_size_bytes":2,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-50abfecedc0c00ded4597b1d: done: 0.277598 sec","job_status":"done","queue_duration_s":94.512762,"scheduling_latency_s":94.512863,"redis_calls":23,"redis_duration_s":0.00896,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.004287,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002915,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001758,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.129752,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.15528152,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.277598,"completed_at":"2026-08-15T09:35:57.015Z","load_balancing_strategy":"primary","db_duration_s":0.100697,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2365gitlab # [ 413.273836] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:35:57.018Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"ea9c96395f9bcf55dd4b1a83","created_at":"2026-08-15T09:34:22.247Z","trace_propagation_headers":{"sentry-trace":"a4e0b95ca73b4f929cb73f9a1f002f88-71dc7a86951a47d1","baggage":"sentry-trace_id=a4e0b95ca73b4f929cb73f9a1f002f88,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M02CBCRHQSDE050FECM2WTGP","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:22.262Z","job_size_bytes":2,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-ea9c96395f9bcf55dd4b1a83: start","job_status":"start","queue_duration_s":94.755257,"scheduling_latency_s":94.75529}2366gitlab # [ 413.343701] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:35:57.182Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"ea9c96395f9bcf55dd4b1a83","created_at":"2026-08-15T09:34:22.247Z","trace_propagation_headers":{"sentry-trace":"a4e0b95ca73b4f929cb73f9a1f002f88-71dc7a86951a47d1","baggage":"sentry-trace_id=a4e0b95ca73b4f929cb73f9a1f002f88,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M02CBCRHQSDE050FECM2WTGP","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:22.262Z","job_size_bytes":2,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-ea9c96395f9bcf55dd4b1a83: done: 0.164591 sec","job_status":"done","queue_duration_s":94.755257,"scheduling_latency_s":94.75529,"redis_calls":14,"redis_duration_s":0.004919,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001059,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002383,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001477,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.118594,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.12638994,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.164591,"completed_at":"2026-08-15T09:35:57.182Z","load_balancing_strategy":"primary","db_duration_s":0.035439,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2367gitlab # [ 413.421844] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:35:57.185Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"7f575ae5641d486f79fde684","created_at":"2026-08-15T09:34:23.162Z","trace_propagation_headers":{"sentry-trace":"a4e0b95ca73b4f929cb73f9a1f002f88-71dc7a86951a47d1","baggage":"sentry-trace_id=a4e0b95ca73b4f929cb73f9a1f002f88,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M02CBCRHQSDE050FECM2WTGP","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:23.170Z","job_size_bytes":5,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-7f575ae5641d486f79fde684: start","job_status":"start","queue_duration_s":94.014433,"scheduling_latency_s":94.01446}2368gitlab # [ 413.569460] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:35:57.408Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"7f575ae5641d486f79fde684","created_at":"2026-08-15T09:34:23.162Z","trace_propagation_headers":{"sentry-trace":"a4e0b95ca73b4f929cb73f9a1f002f88-71dc7a86951a47d1","baggage":"sentry-trace_id=a4e0b95ca73b4f929cb73f9a1f002f88,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M02CBCRHQSDE050FECM2WTGP","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:23.170Z","job_size_bytes":5,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-7f575ae5641d486f79fde684: done: 0.223526 sec","job_status":"done","queue_duration_s":94.014433,"scheduling_latency_s":94.01446,"redis_calls":12,"redis_duration_s":0.004004000000000001,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000884,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00255,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00057,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.172622,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004875,"duration_s":0.223526,"completed_at":"2026-08-15T09:35:57.408Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.043016,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2369gitlab # [ 413.668960] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:35:57.410Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"9076a3747f3a601c4cef69c2","created_at":"2026-08-15T09:34:23.205Z","trace_propagation_headers":{"sentry-trace":"a4e0b95ca73b4f929cb73f9a1f002f88-71dc7a86951a47d1","baggage":"sentry-trace_id=a4e0b95ca73b4f929cb73f9a1f002f88,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M02CBCRHQSDE050FECM2WTGP","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:23.210Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-9076a3747f3a601c4cef69c2: start","job_status":"start","queue_duration_s":94.199493,"scheduling_latency_s":94.199511}2370gitlab # [ 413.851201] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:35:57.689Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"9076a3747f3a601c4cef69c2","created_at":"2026-08-15T09:34:23.205Z","trace_propagation_headers":{"sentry-trace":"a4e0b95ca73b4f929cb73f9a1f002f88-71dc7a86951a47d1","baggage":"sentry-trace_id=a4e0b95ca73b4f929cb73f9a1f002f88,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M02CBCRHQSDE050FECM2WTGP","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:23.210Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-9076a3747f3a601c4cef69c2: done: 0.279681 sec","job_status":"done","queue_duration_s":94.199493,"scheduling_latency_s":94.199511,"redis_calls":11,"redis_duration_s":0.003382,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000751,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001883,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000748,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.043,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.236,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.236,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.041,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.172262,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0006044,"duration_s":0.279681,"completed_at":"2026-08-15T09:35:57.689Z","load_balancing_strategy":"primary","db_duration_s":0.110794,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2371gitlab # [ 413.947946] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:35:57.692Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"524f44d15f1302dbbbe6c445","created_at":"2026-08-15T09:34:23.214Z","trace_propagation_headers":{"sentry-trace":"a4e0b95ca73b4f929cb73f9a1f002f88-71dc7a86951a47d1","baggage":"sentry-trace_id=a4e0b95ca73b4f929cb73f9a1f002f88,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M02CBCRHQSDE050FECM2WTGP","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:23.220Z","job_size_bytes":89,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-524f44d15f1302dbbbe6c445: start","job_status":"start","queue_duration_s":94.472327,"scheduling_latency_s":94.472353}2372gitlab # [ 413.973871] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:35:57.753Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"524f44d15f1302dbbbe6c445","created_at":"2026-08-15T09:34:23.214Z","trace_propagation_headers":{"sentry-trace":"a4e0b95ca73b4f929cb73f9a1f002f88-71dc7a86951a47d1","baggage":"sentry-trace_id=a4e0b95ca73b4f929cb73f9a1f002f88,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M02CBCRHQSDE050FECM2WTGP","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:23.220Z","job_size_bytes":89,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-524f44d15f1302dbbbe6c445: done: 0.060804 sec","job_status":"done","queue_duration_s":94.472327,"scheduling_latency_s":94.472353,"redis_calls":11,"redis_duration_s":0.003976,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00087,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00237,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000736,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037735,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000936,"duration_s":0.060804,"completed_at":"2026-08-15T09:35:57.753Z","load_balancing_strategy":"primary","db_duration_s":0.009434,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2373gitlab # [ 414.027872] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:35:57.757Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 e906b9a8d4041fc27a4d455c0fa988f8d6ec5d83 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"7bfa9e1975670907a320f747","created_at":"2026-08-15T09:34:25.433Z","trace_propagation_headers":{"sentry-trace":"9fda4dc3ebae4db3a19528a062575d56-b3373f43d9984483","baggage":"sentry-trace_id=9fda4dc3ebae4db3a19528a062575d56,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M02CBGS014N3S3QNN2N58H0B","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:25.468Z","job_size_bytes":185,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-7bfa9e1975670907a320f747: start","job_status":"start","queue_duration_s":92.288588,"scheduling_latency_s":92.28863}2374gitlab # [ 414.046523] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:35:57.797Z","message":"changes: \"0000000000000000000000000000000000000000 e906b9a8d4041fc27a4d455c0fa988f8d6ec5d83 refs/heads/master\\n\""}2375gitlab # [ 414.049538] gitaly[900]: time="2026-08-15T09:35:57.873Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M02CBGS014N3S3QNN2N58H0B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T09:36:07.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T09:35:57.856" grpc.time_ms=16.681 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2376gitlab # [ 414.063641] gitaly[900]: time="2026-08-15T09:35:57.897Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CBGS014N3S3QNN2N58H0B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-15T09:36:07.033" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T09:35:57.883" grpc.time_ms=13.567 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2377gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2378gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.06 seconds)2379gitlab # [ 414.162859] nixbot[3476]: INFO: ::ffff:127.0.0.1:59998 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2380gitlab # [ 414.170025] gitaly[900]: time="2026-08-15T09:35:58.002Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=4 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M02CBGS014N3S3QNN2N58H0B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-15T09:36:07.131" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T09:35:57.982" grpc.time_ms=20.314 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2381gitlab # [ 414.246340] gitaly[900]: time="2026-08-15T09:35:58.085Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M02CBGS014N3S3QNN2N58H0B grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3937 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T09:35:58.084" grpc.time_ms=0.932 pid=900 span.kind=server system=grpc2382gitlab # [ 414.303188] gitaly[900]: time="2026-08-15T09:35:58.142Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M02CBGS014N3S3QNN2N58H0B grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3939 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T09:35:58.141" grpc.time_ms=0.719 pid=900 span.kind=server system=grpc2383gitlab # [ 414.333669] gitaly[900]: time="2026-08-15T09:35:58.153Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M02CBGS014N3S3QNN2N58H0B diskcache=dcd8f8b9-8d8c-4575-944c-31b1d07ff141 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-15T09:36:08.007" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T09:35:58.027" pid=900 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2384gitlab # [ 414.362633] gitaly[900]: time="2026-08-15T09:35:58.154Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=136 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5155 command.oublock=8 command.real_time_ms=119 command.spawn_token_fork_ms=1 command.system_time_ms=78 command.user_time_ms=58 component=gitaly.UnaryServerInterceptor correlation_id=01M02CBGS014N3S3QNN2N58H0B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-15T09:36:08.007" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T09:35:58.027" grpc.time_ms=126.266 pid=900 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root2385gitlab # [ 414.390960] gitaly[900]: time="2026-08-15T09:35:58.179Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M02CBGS014N3S3QNN2N58H0B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-15T09:36:08.158" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T09:35:58.179" grpc.time_ms=0.339 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2386gitlab # [ 414.407951] gitaly[900]: time="2026-08-15T09:35:58.212Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=860 command.oublock=0 command.real_time_ms=22 command.spawn_token_fork_ms=3 command.system_time_ms=13 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M02CBGS014N3S3QNN2N58H0B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-15T09:36:08.166" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T09:35:58.186" grpc.time_ms=25.199 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2387gitlab # [ 414.533352] gitaly[900]: time="2026-08-15T09:35:58.372Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=313 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M02CBGS014N3S3QNN2N58H0B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-08-15T09:36:28.060" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:35:58.361" grpc.time_ms=11.487 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2388gitlab # [ 414.588801] gitaly[900]: time="2026-08-15T09:35:58.428Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M02CBGS014N3S3QNN2N58H0B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-15T09:36:08.006" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T09:35:58.427" grpc.time_ms=0.673 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2389gitlab # [ 414.621056] gitaly[900]: time="2026-08-15T09:35:58.442Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=317 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M02CBGS014N3S3QNN2N58H0B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-15T09:36:08.011" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-08-15T09:35:58.431" grpc.time_ms=10.962 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2390gitlab # [ 414.650191] gitaly[900]: time="2026-08-15T09:35:58.485Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M02CBGS014N3S3QNN2N58H0B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T09:36:08.048" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T09:35:58.468" grpc.time_ms=16.477 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2391gitlab # [ 414.674164] gitaly[900]: time="2026-08-15T09:35:58.513Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M02CBGS014N3S3QNN2N58H0B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T09:36:08.076" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T09:35:58.496" grpc.time_ms=16.686 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2392gitlab # [ 414.727172] gitaly[900]: time="2026-08-15T09:35:58.566Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=21 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=881 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=3 command.system_time_ms=18 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M02CBGS014N3S3QNN2N58H0B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-15T09:36:28.237" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:35:58.537" grpc.time_ms=28.547 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2393gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2394gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.06 seconds)2395gitlab # [ 415.222075] nixbot[3476]: INFO: ::ffff:127.0.0.1:60000 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2396gitlab # [ 415.300571] gitaly[900]: time="2026-08-15T09:35:59.138Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M02CBGS014N3S3QNN2N58H0B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-15T09:36:09.116" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:35:59.136" grpc.time_ms=1.786 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2397gitlab # [ 415.374467] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:35:59.211Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 e906b9a8d4041fc27a4d455c0fa988f8d6ec5d83 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"7bfa9e1975670907a320f747","created_at":"2026-08-15T09:34:25.433Z","trace_propagation_headers":{"sentry-trace":"9fda4dc3ebae4db3a19528a062575d56-b3373f43d9984483","baggage":"sentry-trace_id=9fda4dc3ebae4db3a19528a062575d56,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M02CBGS014N3S3QNN2N58H0B","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:25.468Z","job_size_bytes":185,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-7bfa9e1975670907a320f747: done: 1.454867 sec","job_status":"done","queue_duration_s":92.288588,"scheduling_latency_s":92.28863,"gitaly_calls":13,"gitaly_duration_s":0.351889,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.068176,"redis_read_bytes":2103,"redis_write_bytes":21746,"redis_cache_calls":15,"redis_cache_duration_s":0.006512,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.009445,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.002147,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7834,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.005671,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.02899,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.015411,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.089,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.308,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.355,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.089,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.953973,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00141586,"exclusive_lock_hold_duration_s":0.05222368,"duration_s":1.454867,"completed_at":"2026-08-15T09:35:59.211Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.155471,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2398gitlab # [ 415.475123] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:35:59.216Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","e906b9a8d4041fc27a4d455c0fa988f8d6ec5d83 d0eb289c9176791805276b07dcdcb4ec8ff5e39c refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"8b4e76bfa1dbe26fa8e6c4bc","created_at":"2026-08-15T09:34:30.327Z","trace_propagation_headers":{"sentry-trace":"9b88065261fd48e1acb7f1b5642de805-f47b6d35d6d0427b","baggage":"sentry-trace_id=9b88065261fd48e1acb7f1b5642de805,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M02CBNX3C2B3ZSXSHA0B8DDC","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:30.334Z","job_size_bytes":185,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-8b4e76bfa1dbe26fa8e6c4bc: start","job_status":"start","queue_duration_s":88.88212,"scheduling_latency_s":88.882175}2399gitlab # [ 415.495093] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:35:59.247Z","message":"changes: \"e906b9a8d4041fc27a4d455c0fa988f8d6ec5d83 d0eb289c9176791805276b07dcdcb4ec8ff5e39c refs/heads/master\\n\""}2400gitlab # [ 415.497864] gitaly[900]: time="2026-08-15T09:35:59.302Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M02CBNX3C2B3ZSXSHA0B8DDC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T09:36:09.264" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T09:35:59.285" grpc.time_ms=17.53 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2401gitlab # [ 415.510965] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:35:59.335Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"9bc2c28fa33e963173836d1c","created_at":"2026-08-15T09:35:59.332Z","trace_propagation_headers":{"sentry-trace":"9b88065261fd48e1acb7f1b5642de805-1da18cc3b6d04b8d","baggage":"sentry-trace_id=9b88065261fd48e1acb7f1b5642de805,sentry-release=Unknown"},"correlation_id":"01M02CBNX3C2B3ZSXSHA0B8DDC","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"03427f362c0b4a7d681414b6","job_size_bytes":46,"pid":3484,"job_status":"deduplicated","message":"ProjectCacheWorker JID-9bc2c28fa33e963173836d1c: deduplicated: until executing","deduplication.type":"until executing"}2402gitlab # [ 415.525473] gitaly[900]: time="2026-08-15T09:35:59.328Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CBNX3C2B3ZSXSHA0B8DDC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-15T09:36:09.291" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T09:35:59.311" grpc.time_ms=15.924 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2403gitlab # [ 415.538720] gitaly[900]: time="2026-08-15T09:35:59.376Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M02CBNX3C2B3ZSXSHA0B8DDC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-15T09:36:09.008" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T09:35:59.359" grpc.time_ms=16.917 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2404gitlab # [ 415.563558] gitaly[900]: time="2026-08-15T09:35:59.403Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=597 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M02CBNX3C2B3ZSXSHA0B8DDC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-08-15T09:36:29.084" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:35:59.384" grpc.time_ms=18.555 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2405gitlab # [ 415.605693] gitaly[900]: time="2026-08-15T09:35:59.425Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=319 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M02CBNX3C2B3ZSXSHA0B8DDC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-15T09:36:09.063" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-08-15T09:35:59.414" grpc.time_ms=10.929 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2406gitlab # [ 415.633346] gitaly[900]: time="2026-08-15T09:35:59.458Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M02CBNX3C2B3ZSXSHA0B8DDC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T09:36:09.021" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T09:35:59.442" grpc.time_ms=15.793 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2407gitlab # [ 415.930862] gitaly[900]: time="2026-08-15T09:35:59.770Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M02CBNX3C2B3ZSXSHA0B8DDC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-15T09:36:09.206" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:35:59.627" grpc.time_ms=142.953 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2408gitlab # [ 415.969866] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:35:59.794Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","e906b9a8d4041fc27a4d455c0fa988f8d6ec5d83 d0eb289c9176791805276b07dcdcb4ec8ff5e39c refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"8b4e76bfa1dbe26fa8e6c4bc","created_at":"2026-08-15T09:34:30.327Z","trace_propagation_headers":{"sentry-trace":"9b88065261fd48e1acb7f1b5642de805-f47b6d35d6d0427b","baggage":"sentry-trace_id=9b88065261fd48e1acb7f1b5642de805,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M02CBNX3C2B3ZSXSHA0B8DDC","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-15T09:34:30.334Z","job_size_bytes":185,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-8b4e76bfa1dbe26fa8e6c4bc: done: 0.577612 sec","job_status":"done","queue_duration_s":88.88212,"scheduling_latency_s":88.882175,"gitaly_calls":7,"gitaly_duration_s":0.264294,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.037442,"redis_read_bytes":500,"redis_write_bytes":11942,"redis_cache_calls":9,"redis_cache_duration_s":0.004213,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001592,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5719,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.006146,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.012433,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.013058,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.041,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.045,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.045,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.041,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.401224,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00149534,"exclusive_lock_hold_duration_s":0.03471828,"duration_s":0.577612,"completed_at":"2026-08-15T09:35:59.793Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.042854,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2409gitlab # [ 416.068472] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:35:59.796Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"32fe144ba73f5da42e947393","created_at":"2026-08-15T09:34:30.919Z","trace_propagation_headers":{"sentry-trace":"4f278a50c41c4447b07d7b3783461d75-6690963a76d045b3","baggage":"sentry-trace_id=4f278a50c41c4447b07d7b3783461d75,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M02CBPJ74XHM99VDN0EHZ2K4","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:30.929Z","job_size_bytes":65,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-32fe144ba73f5da42e947393: start","job_status":"start","queue_duration_s":88.866943,"scheduling_latency_s":88.86697}2410gitlab # [ 416.089761] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:35:59.912Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"32fe144ba73f5da42e947393","created_at":"2026-08-15T09:34:30.919Z","trace_propagation_headers":{"sentry-trace":"4f278a50c41c4447b07d7b3783461d75-6690963a76d045b3","baggage":"sentry-trace_id=4f278a50c41c4447b07d7b3783461d75,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M02CBPJ74XHM99VDN0EHZ2K4","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:30.929Z","job_size_bytes":65,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-32fe144ba73f5da42e947393: done: 0.115648 sec","job_status":"done","queue_duration_s":88.866943,"scheduling_latency_s":88.86697,"redis_calls":16,"redis_duration_s":0.007474,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.005101,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001743,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00063,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.068461,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00052204,"duration_s":0.115648,"completed_at":"2026-08-15T09:35:59.912Z","load_balancing_strategy":"primary","db_duration_s":0.03657,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2411gitlab # [ 416.136073] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:35:59.914Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"0a0f233ba56c0e4d61f030fd","created_at":"2026-08-15T09:34:30.930Z","trace_propagation_headers":{"sentry-trace":"4f278a50c41c4447b07d7b3783461d75-6690963a76d045b3","baggage":"sentry-trace_id=4f278a50c41c4447b07d7b3783461d75,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M02CBPJ74XHM99VDN0EHZ2K4","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:30.938Z","job_size_bytes":65,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-0a0f233ba56c0e4d61f030fd: start","job_status":"start","queue_duration_s":88.975421,"scheduling_latency_s":88.975443}2412gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2413gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.06 seconds)2414gitlab # [ 416.232974] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:00.071Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"0a0f233ba56c0e4d61f030fd","created_at":"2026-08-15T09:34:30.930Z","trace_propagation_headers":{"sentry-trace":"4f278a50c41c4447b07d7b3783461d75-6690963a76d045b3","baggage":"sentry-trace_id=4f278a50c41c4447b07d7b3783461d75,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M02CBPJ74XHM99VDN0EHZ2K4","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:30.938Z","job_size_bytes":65,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-0a0f233ba56c0e4d61f030fd: done: 0.15735 sec","job_status":"done","queue_duration_s":88.975421,"scheduling_latency_s":88.975443,"redis_calls":21,"redis_duration_s":0.006753,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.002862,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002006,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001885,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.043,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.031,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.094984,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0006646,"duration_s":0.15735,"completed_at":"2026-08-15T09:36:00.071Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.050772,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2415gitlab # [ 416.333076] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:00.074Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"3d7cb63205dfb0dab5061133","created_at":"2026-08-15T09:34:31.111Z","trace_propagation_headers":{"sentry-trace":"4f278a50c41c4447b07d7b3783461d75-6690963a76d045b3","baggage":"sentry-trace_id=4f278a50c41c4447b07d7b3783461d75,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M02CBPJ74XHM99VDN0EHZ2K4","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:31.119Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-3d7cb63205dfb0dab5061133: start","job_status":"start","queue_duration_s":88.95447,"scheduling_latency_s":88.954496}2416gitlab # [ 416.355397] nixbot[3476]: INFO: ::ffff:127.0.0.1:60008 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2417gitlab # [ 416.565716] gitaly[900]: time="2026-08-15T09:36:00.404Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M02CBPJ74XHM99VDN0EHZ2K4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T09:36:00.403" grpc.time_ms=0.907 pid=900 span.kind=server system=grpc2418gitlab # [ 416.608908] gitaly[900]: time="2026-08-15T09:36:00.448Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M02CBPJ74XHM99VDN0EHZ2K4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T09:36:00.447" grpc.time_ms=0.872 pid=900 span.kind=server system=grpc2419gitlab # [ 416.662623] gitaly[900]: time="2026-08-15T09:36:00.501Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M02CBPJ74XHM99VDN0EHZ2K4 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T09:36:00.500" grpc.time_ms=0.825 pid=900 span.kind=server system=grpc2420gitlab # [ 416.693017] gitaly[900]: time="2026-08-15T09:36:00.515Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M02CBPJ74XHM99VDN0EHZ2K4 diskcache=64913b68-acac-4ddf-85f7-ba5210def096 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-15T09:36:30.048" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-15T09:36:00.349" pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2421gitlab # [ 416.713966] gitaly[900]: time="2026-08-15T09:36:00.516Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=186 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7389 command.oublock=0 command.real_time_ms=159 command.spawn_token_fork_ms=1 command.system_time_ms=98 command.user_time_ms=88 component=gitaly.UnaryServerInterceptor correlation_id=01M02CBPJ74XHM99VDN0EHZ2K4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-15T09:36:30.048" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T09:36:00.349" grpc.time_ms=166.521 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2422gitlab # [ 416.924525] gitaly[900]: time="2026-08-15T09:36:00.763Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M02CBPJ74XHM99VDN0EHZ2K4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-15T09:36:30.461" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:36:00.761" grpc.time_ms=1.824 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2423gitlab # [ 417.001650] gitaly[900]: time="2026-08-15T09:36:00.841Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CBPJ74XHM99VDN0EHZ2K4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T09:36:30.538" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:36:00.839" grpc.time_ms=1.466 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2424gitlab # [ 417.046294] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:00.883Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"3d7cb63205dfb0dab5061133","created_at":"2026-08-15T09:34:31.111Z","trace_propagation_headers":{"sentry-trace":"4f278a50c41c4447b07d7b3783461d75-6690963a76d045b3","baggage":"sentry-trace_id=4f278a50c41c4447b07d7b3783461d75,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M02CBPJ74XHM99VDN0EHZ2K4","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-15T09:34:31.119Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-3d7cb63205dfb0dab5061133: done: 0.809467 sec","job_status":"done","queue_duration_s":88.95447,"scheduling_latency_s":88.954496,"gitaly_calls":3,"gitaly_duration_s":0.182105,"redis_calls":117,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.045983,"redis_read_bytes":457,"redis_write_bytes":27997,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002393,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.002326,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.016451,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":25,"redis_queues_duration_s":0.007205,"redis_queues_read_bytes":36,"redis_queues_write_bytes":14491,"redis_queues_metadata_calls":21,"redis_queues_metadata_duration_s":0.009621,"redis_queues_metadata_read_bytes":32,"redis_queues_metadata_write_bytes":3370,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.001224,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000886,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003484,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.105,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.045,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.049,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.053,"db_ci_duration_s":0.052,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.494893,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.7033513,"duration_s":0.809467,"completed_at":"2026-08-15T09:36:00.883Z","load_balancing_strategy":"primary","db_duration_s":0.121408,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2425gitlab # [ 417.124462] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:00.887Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"03427f362c0b4a7d681414b6","created_at":"2026-08-15T09:35:57.902Z","trace_propagation_headers":{"sentry-trace":"9fda4dc3ebae4db3a19528a062575d56-482b354a7f114379","baggage":"sentry-trace_id=9fda4dc3ebae4db3a19528a062575d56,sentry-release=Unknown"},"correlation_id":"01M02CBGS014N3S3QNN2N58H0B","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-15T09:35:57.938Z","job_size_bytes":46,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-03427f362c0b4a7d681414b6: start","job_status":"start","queue_duration_s":2.948252,"scheduling_latency_s":2.948297}2426gitlab # [ 417.142766] gitaly[900]: time="2026-08-15T09:36:00.982Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M02CBGS014N3S3QNN2N58H0B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-08-15T15:36:00.970" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T09:36:00.971" grpc.time_ms=10.271 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2427gitlab # [ 417.179868] gitaly[900]: time="2026-08-15T09:36:01.019Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=595 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M02CBGS014N3S3QNN2N58H0B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-15T09:36:30.700" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:36:01.001" grpc.time_ms=17.558 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2428gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2429gitlab # [ 417.234746] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:01.073Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"03427f362c0b4a7d681414b6","created_at":"2026-08-15T09:35:57.902Z","trace_propagation_headers":{"sentry-trace":"9fda4dc3ebae4db3a19528a062575d56-482b354a7f114379","baggage":"sentry-trace_id=9fda4dc3ebae4db3a19528a062575d56,sentry-release=Unknown"},"correlation_id":"01M02CBGS014N3S3QNN2N58H0B","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-15T09:35:57.938Z","job_size_bytes":46,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-03427f362c0b4a7d681414b6: done: 0.186267 sec","job_status":"done","queue_duration_s":2.948252,"scheduling_latency_s":2.948297,"gitaly_calls":2,"gitaly_duration_s":0.036111,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.012435,"redis_read_bytes":69,"redis_write_bytes":4887,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.002908,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.001047,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2115,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002821,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.004481,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001178,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.117954,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0005727,"duration_s":0.186267,"completed_at":"2026-08-15T09:36:01.073Z","load_balancing_strategy":"primary","db_duration_s":0.020075,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2430gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.05 seconds)2431gitlab # [ 417.320730] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:01.075Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"be45907543c0f72ac08581c6","created_at":"2026-08-15T09:35:57.966Z","trace_propagation_headers":{"sentry-trace":"9fda4dc3ebae4db3a19528a062575d56-482b354a7f114379","baggage":"sentry-trace_id=9fda4dc3ebae4db3a19528a062575d56,sentry-release=Unknown"},"correlation_id":"01M02CBGS014N3S3QNN2N58H0B","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-15T09:35:57.974Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-be45907543c0f72ac08581c6: start","job_status":"start","queue_duration_s":3.10116,"scheduling_latency_s":3.10119}2432gitlab # [ 417.343641] gitaly[900]: time="2026-08-15T09:36:01.153Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M02CBGS014N3S3QNN2N58H0B diskcache=92c1e64a-978a-47a9-a3ae-19290afd1c5c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-15T15:36:01.111" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:36:01.112" pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2433gitlab # [ 417.357538] nixbot[3476]: INFO: ::ffff:127.0.0.1:60020 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2434gitlab # [ 417.360158] gitaly[900]: time="2026-08-15T09:36:01.154Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=27 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1175 command.oublock=0 command.real_time_ms=53 command.spawn_token_fork_ms=4 command.system_time_ms=27 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CBGS014N3S3QNN2N58H0B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-15T15:36:01.111" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:36:01.112" grpc.time_ms=41.875 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2435gitlab # [ 417.407178] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:01.245Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"be45907543c0f72ac08581c6","created_at":"2026-08-15T09:35:57.966Z","trace_propagation_headers":{"sentry-trace":"9fda4dc3ebae4db3a19528a062575d56-482b354a7f114379","baggage":"sentry-trace_id=9fda4dc3ebae4db3a19528a062575d56,sentry-release=Unknown"},"correlation_id":"01M02CBGS014N3S3QNN2N58H0B","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-15T09:35:57.974Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-be45907543c0f72ac08581c6: done: 0.169759 sec","job_status":"done","queue_duration_s":3.10116,"scheduling_latency_s":3.10119,"gitaly_calls":1,"gitaly_duration_s":0.049921,"redis_calls":15,"redis_duration_s":0.005815,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000636,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002426,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000869,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001884,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.025,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.046,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.083015,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.12576202,"duration_s":0.169759,"completed_at":"2026-08-15T09:36:01.245Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027854,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2436gitlab # [ 417.475246] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:01.249Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"5cb2ac873c7446e2bbde9e98","created_at":"2026-08-15T09:35:58.172Z","trace_propagation_headers":{"sentry-trace":"9fda4dc3ebae4db3a19528a062575d56-482b354a7f114379","baggage":"sentry-trace_id=9fda4dc3ebae4db3a19528a062575d56,sentry-release=Unknown"},"correlation_id":"01M02CBGS014N3S3QNN2N58H0B","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-15T09:35:58.175Z","job_size_bytes":23,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-5cb2ac873c7446e2bbde9e98: start","job_status":"start","queue_duration_s":3.073703,"scheduling_latency_s":3.073743}2437gitlab # [ 417.493109] gitaly[900]: time="2026-08-15T09:36:01.322Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=595 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CBGS014N3S3QNN2N58H0B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-15T09:36:31.003" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:36:01.304" grpc.time_ms=18.064 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2438gitlab # [ 417.506319] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:01.339Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"5cb2ac873c7446e2bbde9e98","created_at":"2026-08-15T09:35:58.172Z","trace_propagation_headers":{"sentry-trace":"9fda4dc3ebae4db3a19528a062575d56-482b354a7f114379","baggage":"sentry-trace_id=9fda4dc3ebae4db3a19528a062575d56,sentry-release=Unknown"},"correlation_id":"01M02CBGS014N3S3QNN2N58H0B","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-15T09:35:58.175Z","job_size_bytes":23,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-5cb2ac873c7446e2bbde9e98: done: 0.090005 sec","job_status":"done","queue_duration_s":3.073703,"scheduling_latency_s":3.073743,"gitaly_calls":1,"gitaly_duration_s":0.021819,"redis_calls":16,"redis_duration_s":0.005987,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000447,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001696,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.002714,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00113,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.053981,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.090005,"completed_at":"2026-08-15T09:36:01.339Z","load_balancing_strategy":"primary","db_duration_s":0.005647,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2439gitlab # [ 417.552584] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:01.342Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"f56e6f6651b60b9d621a7204","created_at":"2026-08-15T09:35:58.945Z","trace_propagation_headers":{"sentry-trace":"9fda4dc3ebae4db3a19528a062575d56-482b354a7f114379","baggage":"sentry-trace_id=9fda4dc3ebae4db3a19528a062575d56,sentry-release=Unknown"},"correlation_id":"01M02CBGS014N3S3QNN2N58H0B","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ef4e5ef81280145b12f8d28a3c53e5bc7ca85977a1f5d6e9c867941ea01e5e94","size_limiter":"validated","enqueued_at":"2026-08-15T09:35:58.952Z","job_size_bytes":467,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-f56e6f6651b60b9d621a7204: start","job_status":"start","queue_duration_s":2.389963,"scheduling_latency_s":2.389993}2440gitlab # [ 417.570025] gitaly[900]: time="2026-08-15T09:36:01.385Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CBGS014N3S3QNN2N58H0B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T09:36:31.083" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:36:01.384" grpc.time_ms=1.087 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2441gitlab # [ 417.582365] gitaly[900]: time="2026-08-15T09:36:01.407Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M02CBGS014N3S3QNN2N58H0B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-15T09:36:11.038" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T09:36:01.389" grpc.time_ms=18.106 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2442gitlab # [ 417.794149] gitaly[900]: time="2026-08-15T09:36:01.633Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M02CBGS014N3S3QNN2N58H0B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-15T09:36:31.331" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:36:01.631" grpc.time_ms=1.751 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2443gitlab # [ 417.833134] gitaly[900]: time="2026-08-15T09:36:01.643Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=29 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M02CBGS014N3S3QNN2N58H0B error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-15T09:36:31.339" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:36:01.639" grpc.time_ms=4.017 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2444gitlab # [ 417.932738] gitaly[900]: time="2026-08-15T09:36:01.772Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M02CBGS014N3S3QNN2N58H0B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T09:36:11.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T09:36:01.754" grpc.time_ms=17.128 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2445gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2446gitlab # [ 418.402796] nixbot[3476]: INFO: ::ffff:127.0.0.1:60032 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2447gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.06 seconds)2448gitlab # [ 418.641947] gitaly[900]: time="2026-08-15T09:36:02.480Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=21 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=880 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=3 command.system_time_ms=21 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M02CBGS014N3S3QNN2N58H0B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-15T09:36:32.151" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:36:02.451" grpc.time_ms=28.387 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2449gitlab # [ 418.685629] gitaly[900]: time="2026-08-15T09:36:02.511Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=3 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M02CBGS014N3S3QNN2N58H0B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-15T09:36:32.186" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:36:02.486" grpc.time_ms=24.631 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2450gitlab # [ 418.738547] sidekiq-cluster[3484]: {"severity":"WARN","time":"2026-08-15T09:36:02.576Z","class":"CreatePipelineWorker","correlation_id":"01M02CBGS014N3S3QNN2N58H0B","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"e906b9a8d4041fc27a4d455c0fa988f8d6ec5d83","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"e906b9a8d4041fc27a4d455c0fa988f8d6ec5d83","ref":"refs/heads/master"},"retry":0}2451gitlab # [ 418.758203] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:02.594Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"f56e6f6651b60b9d621a7204","created_at":"2026-08-15T09:35:58.945Z","trace_propagation_headers":{"sentry-trace":"9fda4dc3ebae4db3a19528a062575d56-482b354a7f114379","baggage":"sentry-trace_id=9fda4dc3ebae4db3a19528a062575d56,sentry-release=Unknown"},"correlation_id":"01M02CBGS014N3S3QNN2N58H0B","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ef4e5ef81280145b12f8d28a3c53e5bc7ca85977a1f5d6e9c867941ea01e5e94","size_limiter":"validated","enqueued_at":"2026-08-15T09:35:58.952Z","job_size_bytes":467,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-f56e6f6651b60b9d621a7204: done: 1.252671 sec","job_status":"done","queue_duration_s":2.389963,"scheduling_latency_s":2.389993,"gitaly_calls":7,"gitaly_duration_s":0.121254,"redis_calls":51,"redis_duration_s":0.016358,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.001682,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.007079,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00224,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.00364,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001717,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.047,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.04,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.04805,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00064546,"duration_s":1.252671,"completed_at":"2026-08-15T09:36:02.594Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.088889,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2452gitlab # [ 418.835548] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:02.598Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"3e966b5b-d064-4839-91f6-e14c28088996\"}"],"class":"WebHookWorker","jid":"dfa843e08fc8c3602d605882","created_at":"2026-08-15T09:35:59.099Z","trace_propagation_headers":{"sentry-trace":"9fda4dc3ebae4db3a19528a062575d56-482b354a7f114379","baggage":"sentry-trace_id=9fda4dc3ebae4db3a19528a062575d56,sentry-release=Unknown"},"correlation_id":"01M02CBGS014N3S3QNN2N58H0B","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9d456f925c72def5f43049f635d5246c3d3476f0fe7deda6f8ed30ed4bd37e21","size_limiter":"validated","enqueued_at":"2026-08-15T09:35:59.105Z","job_size_bytes":1751,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-dfa843e08fc8c3602d605882: start","job_status":"start","queue_duration_s":3.492353,"scheduling_latency_s":3.492393}2453gitlab # [ 418.972104] nixbot[3476]: INFO: ::ffff:127.0.0.1:60048 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2454gitlab # [ 419.008721] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:02.846Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"3e966b5b-d064-4839-91f6-e14c28088996\"}"],"class":"WebHookWorker","jid":"dfa843e08fc8c3602d605882","created_at":"2026-08-15T09:35:59.099Z","trace_propagation_headers":{"sentry-trace":"9fda4dc3ebae4db3a19528a062575d56-482b354a7f114379","baggage":"sentry-trace_id=9fda4dc3ebae4db3a19528a062575d56,sentry-release=Unknown"},"correlation_id":"01M02CBGS014N3S3QNN2N58H0B","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9d456f925c72def5f43049f635d5246c3d3476f0fe7deda6f8ed30ed4bd37e21","size_limiter":"validated","enqueued_at":"2026-08-15T09:35:59.105Z","job_size_bytes":1751,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-dfa843e08fc8c3602d605882: done: 0.248541 sec","job_status":"done","queue_duration_s":3.492353,"scheduling_latency_s":3.492393,"redis_calls":19,"redis_duration_s":0.006904,"redis_read_bytes":32,"redis_write_bytes":5368,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001742,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000598,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3730,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00284,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001724,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.08935612000004767,"cpu_s":0.135221,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00071482,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.248541,"completed_at":"2026-08-15T09:36:02.846Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005727,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2455gitlab # [ 419.129761] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:02.851Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"010c512d04b24531980cbeb9","created_at":"2026-08-15T09:35:59.347Z","trace_propagation_headers":{"sentry-trace":"9b88065261fd48e1acb7f1b5642de805-1da18cc3b6d04b8d","baggage":"sentry-trace_id=9b88065261fd48e1acb7f1b5642de805,sentry-release=Unknown"},"correlation_id":"01M02CBNX3C2B3ZSXSHA0B8DDC","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"be45907543c0f72ac08581c6","size_limiter":"validated","enqueued_at":"2026-08-15T09:35:59.351Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-010c512d04b24531980cbeb9: start","job_status":"start","queue_duration_s":3.499041,"scheduling_latency_s":3.499082}2456gitlab # [ 419.157380] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:02.939Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"010c512d04b24531980cbeb9","created_at":"2026-08-15T09:35:59.347Z","trace_propagation_headers":{"sentry-trace":"9b88065261fd48e1acb7f1b5642de805-1da18cc3b6d04b8d","baggage":"sentry-trace_id=9b88065261fd48e1acb7f1b5642de805,sentry-release=Unknown"},"correlation_id":"01M02CBNX3C2B3ZSXSHA0B8DDC","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"be45907543c0f72ac08581c6","size_limiter":"validated","enqueued_at":"2026-08-15T09:35:59.351Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-010c512d04b24531980cbeb9: done: 0.088195 sec","job_status":"done","queue_duration_s":3.499041,"scheduling_latency_s":3.499082,"gitaly_calls":1,"gitaly_duration_s":0.032079,"redis_calls":12,"redis_duration_s":0.003459,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001398,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000789,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001272,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.01,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.01,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.044122,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0566713,"duration_s":0.088195,"completed_at":"2026-08-15T09:36:02.938Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006815,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2457gitlab # [ 419.211554] gitaly[900]: time="2026-08-15T09:36:02.893Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M02CBNX3C2B3ZSXSHA0B8DDC diskcache=c065859d-a852-44b9-89e0-79ab1046fbd1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-15T15:36:02.881" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:36:02.882" pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2458gitlab # [ 419.221960] gitaly[900]: time="2026-08-15T09:36:02.893Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=290 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CBNX3C2B3ZSXSHA0B8DDC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-15T15:36:02.881" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:36:02.882" grpc.time_ms=11.369 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2459gitlab # [ 419.234980] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:02.941Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"d9a2f189bf434707083f003f","created_at":"2026-08-15T09:35:59.564Z","trace_propagation_headers":{"sentry-trace":"9b88065261fd48e1acb7f1b5642de805-1da18cc3b6d04b8d","baggage":"sentry-trace_id=9b88065261fd48e1acb7f1b5642de805,sentry-release=Unknown"},"correlation_id":"01M02CBNX3C2B3ZSXSHA0B8DDC","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:27f6264daa7b0032b7e3b47ab6a428f4e6e43727818cc932c20bd0a4efb2b952","size_limiter":"validated","enqueued_at":"2026-08-15T09:35:59.568Z","job_size_bytes":467,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-d9a2f189bf434707083f003f: start","job_status":"start","queue_duration_s":3.372954,"scheduling_latency_s":3.37298}2460gitlab # [ 419.252896] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:36:03 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1922461gitlab # [ 419.254966] gitaly[900]: time="2026-08-15T09:36:02.980Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CBNX3C2B3ZSXSHA0B8DDC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T09:36:32.678" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:36:02.979" grpc.time_ms=1.28 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2462gitlab # [ 419.267507] gitaly[900]: time="2026-08-15T09:36:03.001Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CBNX3C2B3ZSXSHA0B8DDC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-15T09:36:12.233" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T09:36:02.984" grpc.time_ms=16.627 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2463gitlab # [ 419.280513] gitaly[900]: time="2026-08-15T09:36:03.055Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=3 command.system_time_ms=6 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M02CEGSFDKJXT9K4WQ0FJD2F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:36:03.032" grpc.time_ms=22.768 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc2464gitlab # [ 419.293600] gitaly[900]: time="2026-08-15T09:36:03.058Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M02CBNX3C2B3ZSXSHA0B8DDC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-15T09:36:33.056" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:36:03.057" grpc.time_ms=0.969 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2465gitlab # [ 419.307276] gitaly[900]: time="2026-08-15T09:36:03.066Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=84 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M02CBNX3C2B3ZSXSHA0B8DDC error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-15T09:36:33.063" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:36:03.063" grpc.time_ms=3.247 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2466gitlab # [ 419.323957] gitaly[900]: time="2026-08-15T09:36:03.113Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M02CBNX3C2B3ZSXSHA0B8DDC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T09:36:13.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T09:36:03.100" grpc.time_ms=13.792 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2467gitlab # [ 419.390946] gitaly[900]: time="2026-08-15T09:36:03.230Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M02CEGZKRCT2SC1NJW9W1Q7D grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:36:03.217" pid=900 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2468gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2469gitlab # [ 419.409363] gitaly[900]: time="2026-08-15T09:36:03.230Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CEGZKRCT2SC1NJW9W1Q7D grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:36:03.217" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc2470gitlab # [ 419.427544] gitlab-workhorse[821]: time="2026-08-15T09:36:03Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672471gitlab # [ 419.430460] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:36:03 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1762472gitlab # [ 419.433389] gitaly[900]: time="2026-08-15T09:36:03.231Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CEGZKRCT2SC1NJW9W1Q7D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:36:03.217" grpc.time_ms=13.208 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc2473gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.06 seconds)2474gitlab # [ 419.465064] nixbot[3476]: INFO: ::ffff:127.0.0.1:60056 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2475gitlab # [ 419.469220] nixbot[3476]: {"ts": "2026-08-15T09:36:03.306Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"}2476gitlab # [ 419.565601] gitaly[900]: time="2026-08-15T09:36:03.404Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CEH7YRD2TKWQQN3QV9T6Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T09:36:33.402" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:36:03.403" grpc.time_ms=1.182 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2477gitlab # [ 419.706245] gitaly[900]: time="2026-08-15T09:36:03.544Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M02CEH7YRD2TKWQQN3QV9T6Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T09:36:13.026" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T09:36:03.526" grpc.time_ms=17.539 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2478gitlab # [ 419.831602] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:36:03 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e906b9a8d4041fc27a4d455c0fa988f8d6ec5d83 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 3432479gitlab # [ 419.839957] nixbot[3476]: {"ts": "2026-08-15T09:36:03.672Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/e906b9a8d4041fc27a4d455c0fa988f8d6ec5d83 \"HTTP/1.1 201 Created\""}2480gitlab # [ 419.918452] gitaly[900]: time="2026-08-15T09:36:03.757Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CEHJZJ6S9YVP1Q343NDXQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T09:36:33.755" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:36:03.756" grpc.time_ms=0.904 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2481gitlab # [ 419.948124] gitaly[900]: time="2026-08-15T09:36:03.787Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=882 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M02CBNX3C2B3ZSXSHA0B8DDC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-15T09:36:33.772" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:36:03.772" grpc.time_ms=14.533 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2482gitlab # [ 419.975836] gitaly[900]: time="2026-08-15T09:36:03.815Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M02CBNX3C2B3ZSXSHA0B8DDC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-15T09:36:33.791" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:36:03.791" grpc.time_ms=23.432 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2483gitlab # [ 419.994235] sidekiq-cluster[3484]: {"severity":"WARN","time":"2026-08-15T09:36:03.828Z","class":"CreatePipelineWorker","correlation_id":"01M02CBNX3C2B3ZSXSHA0B8DDC","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"e906b9a8d4041fc27a4d455c0fa988f8d6ec5d83","after":"d0eb289c9176791805276b07dcdcb4ec8ff5e39c","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"d0eb289c9176791805276b07dcdcb4ec8ff5e39c","ref":"refs/heads/master"},"retry":0}2484gitlab # [ 420.003101] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:03.834Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"d9a2f189bf434707083f003f","created_at":"2026-08-15T09:35:59.564Z","trace_propagation_headers":{"sentry-trace":"9b88065261fd48e1acb7f1b5642de805-1da18cc3b6d04b8d","baggage":"sentry-trace_id=9b88065261fd48e1acb7f1b5642de805,sentry-release=Unknown"},"correlation_id":"01M02CBNX3C2B3ZSXSHA0B8DDC","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:27f6264daa7b0032b7e3b47ab6a428f4e6e43727818cc932c20bd0a4efb2b952","size_limiter":"validated","enqueued_at":"2026-08-15T09:35:59.568Z","job_size_bytes":467,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-d9a2f189bf434707083f003f: done: 0.892798 sec","job_status":"done","queue_duration_s":3.372954,"scheduling_latency_s":3.37298,"gitaly_calls":7,"gitaly_duration_s":0.095538,"redis_calls":33,"redis_duration_s":0.007737,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.001644,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001766,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003031,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001296,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.771436,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.892798,"completed_at":"2026-08-15T09:36:03.834Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.026578,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2485gitlab # [ 420.052507] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:03.836Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"b8765339-639b-4a5e-b68c-665f91bb2bbf\"}"],"class":"WebHookWorker","jid":"19f724a09589e5a5d112ab50","created_at":"2026-08-15T09:35:59.598Z","trace_propagation_headers":{"sentry-trace":"9b88065261fd48e1acb7f1b5642de805-1da18cc3b6d04b8d","baggage":"sentry-trace_id=9b88065261fd48e1acb7f1b5642de805,sentry-release=Unknown"},"correlation_id":"01M02CBNX3C2B3ZSXSHA0B8DDC","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2a34d33664f57fba57f677edbbda9898484ca3bed1a15ba31ccdeb6b99370419","size_limiter":"validated","enqueued_at":"2026-08-15T09:35:59.602Z","job_size_bytes":1749,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-19f724a09589e5a5d112ab50: start","job_status":"start","queue_duration_s":4.23403,"scheduling_latency_s":4.234054}2486gitlab # [ 420.070860] gitaly[900]: time="2026-08-15T09:36:03.852Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M02CEHJZJ6S9YVP1Q343NDXQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T09:36:13.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T09:36:03.843" grpc.time_ms=8.349 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2487gitlab # [ 420.084285] nixbot[3476]: INFO: ::ffff:127.0.0.1:60064 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2488gitlab # [ 420.105632] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:03.943Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"b8765339-639b-4a5e-b68c-665f91bb2bbf\"}"],"class":"WebHookWorker","jid":"19f724a09589e5a5d112ab50","created_at":"2026-08-15T09:35:59.598Z","trace_propagation_headers":{"sentry-trace":"9b88065261fd48e1acb7f1b5642de805-1da18cc3b6d04b8d","baggage":"sentry-trace_id=9b88065261fd48e1acb7f1b5642de805,sentry-release=Unknown"},"correlation_id":"01M02CBNX3C2B3ZSXSHA0B8DDC","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2a34d33664f57fba57f677edbbda9898484ca3bed1a15ba31ccdeb6b99370419","size_limiter":"validated","enqueued_at":"2026-08-15T09:35:59.602Z","job_size_bytes":1749,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-19f724a09589e5a5d112ab50: done: 0.106457 sec","job_status":"done","queue_duration_s":4.23403,"scheduling_latency_s":4.234054,"redis_calls":14,"redis_duration_s":0.005625,"redis_read_bytes":26,"redis_write_bytes":4684,"redis_queues_calls":2,"redis_queues_duration_s":0.000571,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002541,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002513,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.02127138000003015,"cpu_s":0.056807,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.106457,"completed_at":"2026-08-15T09:36:03.942Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005831,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2489gitlab # [ 420.158966] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:03.947Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"6723dd49a91f13fc151df577","created_at":"2026-08-15T09:36:00.315Z","trace_propagation_headers":{"sentry-trace":"4f278a50c41c4447b07d7b3783461d75-240f25ba50ae430c","baggage":"sentry-trace_id=4f278a50c41c4447b07d7b3783461d75,sentry-release=Unknown"},"correlation_id":"01M02CBPJ74XHM99VDN0EHZ2K4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:00.327Z","job_size_bytes":23,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-6723dd49a91f13fc151df577: start","job_status":"start","queue_duration_s":3.62008,"scheduling_latency_s":3.620116}2490gitlab # [ 420.177045] nixbot[3476]: {"ts": "2026-08-15T09:36:03.970Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/e906b9a8d4041fc27a4d455c0fa988f8d6ec5d83 \"HTTP/1.1 201 Created\""}2491gitlab # [ 420.179958] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:36:03 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e906b9a8d4041fc27a4d455c0fa988f8d6ec5d83 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2792492gitlab # [ 420.205168] gitaly[900]: time="2026-08-15T09:36:04.044Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M02CEHVH9WBE69VJYPYMWEWF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:36:04.036" grpc.time_ms=8.035 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc2493gitlab # [ 420.219200] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:36:04 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 912494gitlab # [ 420.225751] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:04.064Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"6723dd49a91f13fc151df577","created_at":"2026-08-15T09:36:00.315Z","trace_propagation_headers":{"sentry-trace":"4f278a50c41c4447b07d7b3783461d75-240f25ba50ae430c","baggage":"sentry-trace_id=4f278a50c41c4447b07d7b3783461d75,sentry-release=Unknown"},"correlation_id":"01M02CBPJ74XHM99VDN0EHZ2K4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:00.327Z","job_size_bytes":23,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-6723dd49a91f13fc151df577: done: 0.117428 sec","job_status":"done","queue_duration_s":3.62008,"scheduling_latency_s":3.620116,"redis_calls":10,"redis_duration_s":0.006028,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000485,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003687,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001856,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.085318,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0011414,"duration_s":0.117428,"completed_at":"2026-08-15T09:36:04.064Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.02042,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2495gitlab # [ 420.271689] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:04.068Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"f89d3d6c621622e4970653e0","created_at":"2026-08-15T09:36:00.527Z","trace_propagation_headers":{"sentry-trace":"4f278a50c41c4447b07d7b3783461d75-240f25ba50ae430c","baggage":"sentry-trace_id=4f278a50c41c4447b07d7b3783461d75,sentry-release=Unknown"},"correlation_id":"01M02CBPJ74XHM99VDN0EHZ2K4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:00.540Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-f89d3d6c621622e4970653e0: start","job_status":"start","queue_duration_s":3.528407,"scheduling_latency_s":3.528434}2496gitlab # [ 420.289272] gitaly[900]: time="2026-08-15T09:36:04.086Z" level=info msg="finished unary call with code OK" catfile.duration_ms=18 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=18 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CEHWEGP3N13VR7TK274F2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T09:36:34.066" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:36:04.067" grpc.time_ms=18.984 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2497gitlab # [ 420.301988] gitaly[900]: time="2026-08-15T09:36:04.134Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M02CEHYEFETV2P1W2GTPW9BV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:36:04.113" pid=900 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2498gitlab # [ 420.313380] gitlab-workhorse[821]: time="2026-08-15T09:36:04Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672499gitlab # [ 420.315396] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:36:04 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 892500gitlab # [ 420.317576] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:04.130Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"f89d3d6c621622e4970653e0","created_at":"2026-08-15T09:36:00.527Z","trace_propagation_headers":{"sentry-trace":"4f278a50c41c4447b07d7b3783461d75-240f25ba50ae430c","baggage":"sentry-trace_id=4f278a50c41c4447b07d7b3783461d75,sentry-release=Unknown"},"correlation_id":"01M02CBPJ74XHM99VDN0EHZ2K4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:00.540Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-f89d3d6c621622e4970653e0: done: 0.061791 sec","job_status":"done","queue_duration_s":3.528407,"scheduling_latency_s":3.528434,"redis_calls":10,"redis_duration_s":0.006618000000000001,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003138,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002644,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000836,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032684,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00050122,"duration_s":0.061791,"completed_at":"2026-08-15T09:36:04.130Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012591,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2501gitlab # [ 420.366614] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:04.133Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"c1acb15bc7e8089eb73caf38","created_at":"2026-08-15T09:36:00.568Z","trace_propagation_headers":{"sentry-trace":"4f278a50c41c4447b07d7b3783461d75-240f25ba50ae430c","baggage":"sentry-trace_id=4f278a50c41c4447b07d7b3783461d75,sentry-release=Unknown"},"correlation_id":"01M02CBPJ74XHM99VDN0EHZ2K4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:00.580Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-c1acb15bc7e8089eb73caf38: start","job_status":"start","queue_duration_s":3.55309,"scheduling_latency_s":3.553112}2502gitlab # [ 420.383598] gitaly[900]: time="2026-08-15T09:36:04.134Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=7 command.system_time_ms=6 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M02CEHYEFETV2P1W2GTPW9BV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:36:04.113" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc2503gitlab # [ 420.398755] nixbot[3476]: {"ts": "2026-08-15T09:36:04.210Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/e906b9a8d4041fc27a4d455c0fa988f8d6ec5d83 \"HTTP/1.1 201 Created\""}2504gitlab # [ 420.401868] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:04.174Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"c1acb15bc7e8089eb73caf38","created_at":"2026-08-15T09:36:00.568Z","trace_propagation_headers":{"sentry-trace":"4f278a50c41c4447b07d7b3783461d75-240f25ba50ae430c","baggage":"sentry-trace_id=4f278a50c41c4447b07d7b3783461d75,sentry-release=Unknown"},"correlation_id":"01M02CBPJ74XHM99VDN0EHZ2K4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:00.580Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-c1acb15bc7e8089eb73caf38: done: 0.040978 sec","job_status":"done","queue_duration_s":3.55309,"scheduling_latency_s":3.553112,"redis_calls":10,"redis_duration_s":0.001765,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000278,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001163,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000324,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028139,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00049304,"duration_s":0.040978,"completed_at":"2026-08-15T09:36:04.174Z","load_balancing_strategy":"primary","db_duration_s":0.006075,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2505gitlab # [ 420.446530] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:04.176Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"05e4c1fed66fc6883bdfe5af","created_at":"2026-08-15T09:36:00.608Z","trace_propagation_headers":{"sentry-trace":"4f278a50c41c4447b07d7b3783461d75-240f25ba50ae430c","baggage":"sentry-trace_id=4f278a50c41c4447b07d7b3783461d75,sentry-release=Unknown"},"correlation_id":"01M02CBPJ74XHM99VDN0EHZ2K4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:00.619Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-05e4c1fed66fc6883bdfe5af: start","job_status":"start","queue_duration_s":3.556407,"scheduling_latency_s":3.556429}2506gitlab # [ 420.462030] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:36:04 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e906b9a8d4041fc27a4d455c0fa988f8d6ec5d83 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2252507gitlab # [ 420.464681] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:36:04 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 582508gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2509gitlab # [ 420.466710] gitaly[900]: time="2026-08-15T09:36:04.135Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=7 command.system_time_ms=6 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M02CEHYEFETV2P1W2GTPW9BV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:36:04.113" grpc.time_ms=22.007 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc2510gitlab # [ 420.480536] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:04.219Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"05e4c1fed66fc6883bdfe5af","created_at":"2026-08-15T09:36:00.608Z","trace_propagation_headers":{"sentry-trace":"4f278a50c41c4447b07d7b3783461d75-240f25ba50ae430c","baggage":"sentry-trace_id=4f278a50c41c4447b07d7b3783461d75,sentry-release=Unknown"},"correlation_id":"01M02CBPJ74XHM99VDN0EHZ2K4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:00.619Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-05e4c1fed66fc6883bdfe5af: done: 0.04349 sec","job_status":"done","queue_duration_s":3.556407,"scheduling_latency_s":3.556429,"redis_calls":13,"redis_duration_s":0.004329,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002526,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000955,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000459,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000389,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029155,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00028826,"duration_s":0.04349,"completed_at":"2026-08-15T09:36:04.219Z","load_balancing_strategy":"primary","db_duration_s":0.004872,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2511gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.06 seconds)2512gitlab # [ 420.526734] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:04.221Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"9ffacf2f55be951fd6d017cd","created_at":"2026-08-15T09:36:00.621Z","trace_propagation_headers":{"sentry-trace":"4f278a50c41c4447b07d7b3783461d75-240f25ba50ae430c","baggage":"sentry-trace_id=4f278a50c41c4447b07d7b3783461d75,sentry-release=Unknown"},"correlation_id":"01M02CBPJ74XHM99VDN0EHZ2K4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:00.630Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-9ffacf2f55be951fd6d017cd: start","job_status":"start","queue_duration_s":3.590128,"scheduling_latency_s":3.590147}2513gitlab # [ 420.543874] nix-daemon[3683]: accepted connection from pid 4259, user nixbot2514gitlab # [ 420.545020] gitaly[900]: time="2026-08-15T09:36:04.154Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M02CEHWEGP3N13VR7TK274F2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T09:36:14.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T09:36:04.144" grpc.time_ms=9.28 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2515gitlab # [ 420.558246] gitlab-workhorse[821]: time="2026-08-15T09:36:04Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672516gitlab # [ 420.560094] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:36:04 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 702517gitlab # [ 420.562246] nixbot[3476]: INFO: ::ffff:127.0.0.1:60080 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2518gitlab # [ 420.564197] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:04.256Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"9ffacf2f55be951fd6d017cd","created_at":"2026-08-15T09:36:00.621Z","trace_propagation_headers":{"sentry-trace":"4f278a50c41c4447b07d7b3783461d75-240f25ba50ae430c","baggage":"sentry-trace_id=4f278a50c41c4447b07d7b3783461d75,sentry-release=Unknown"},"correlation_id":"01M02CBPJ74XHM99VDN0EHZ2K4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:00.630Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-9ffacf2f55be951fd6d017cd: done: 0.035862 sec","job_status":"done","queue_duration_s":3.590128,"scheduling_latency_s":3.590147,"redis_calls":10,"redis_duration_s":0.001498,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000309,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000898,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000291,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02543,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025666,"duration_s":0.035862,"completed_at":"2026-08-15T09:36:04.256Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004352,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2519gitlab # [ 420.611687] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:04.258Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"0ff5878b42da4b9583139f0b","created_at":"2026-08-15T09:36:00.632Z","trace_propagation_headers":{"sentry-trace":"4f278a50c41c4447b07d7b3783461d75-240f25ba50ae430c","baggage":"sentry-trace_id=4f278a50c41c4447b07d7b3783461d75,sentry-release=Unknown"},"correlation_id":"01M02CBPJ74XHM99VDN0EHZ2K4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:00.642Z","job_size_bytes":19,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-0ff5878b42da4b9583139f0b: start","job_status":"start","queue_duration_s":3.616435,"scheduling_latency_s":3.616456}2520gitlab # [ 420.628322] gitaly[900]: time="2026-08-15T09:36:04.278Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01M02CEJ3W0V7A7Z6NNGH2320V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=202 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:36:04.266" grpc.time_ms=11.242 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc2521gitlab # [ 420.641424] gitaly[900]: time="2026-08-15T09:36:04.350Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M02CEJ5RG4T5DDFRGJWQWFDK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:36:04.337" pid=900 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2522gitlab # [ 420.652290] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:04.295Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"0ff5878b42da4b9583139f0b","created_at":"2026-08-15T09:36:00.632Z","trace_propagation_headers":{"sentry-trace":"4f278a50c41c4447b07d7b3783461d75-240f25ba50ae430c","baggage":"sentry-trace_id=4f278a50c41c4447b07d7b3783461d75,sentry-release=Unknown"},"correlation_id":"01M02CBPJ74XHM99VDN0EHZ2K4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:00.642Z","job_size_bytes":19,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-0ff5878b42da4b9583139f0b: done: 0.036501 sec","job_status":"done","queue_duration_s":3.616435,"scheduling_latency_s":3.616456,"redis_calls":11,"redis_duration_s":0.0043040000000000005,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002994,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000962,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000348,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022622,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022714,"duration_s":0.036501,"completed_at":"2026-08-15T09:36:04.295Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003923,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2523gitlab # [ 420.697336] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:04.296Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"f6749b05a22bcb7c7801443b","created_at":"2026-08-15T09:36:00.648Z","trace_propagation_headers":{"sentry-trace":"4f278a50c41c4447b07d7b3783461d75-240f25ba50ae430c","baggage":"sentry-trace_id=4f278a50c41c4447b07d7b3783461d75,sentry-release=Unknown"},"correlation_id":"01M02CBPJ74XHM99VDN0EHZ2K4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:00.659Z","job_size_bytes":66,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-f6749b05a22bcb7c7801443b: start","job_status":"start","queue_duration_s":3.636448,"scheduling_latency_s":3.636465}2524gitlab # [ 420.714636] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:36:04 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 652525gitlab # [ 420.717249] gitaly[900]: time="2026-08-15T09:36:04.350Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=4 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M02CEJ5RG4T5DDFRGJWQWFDK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:36:04.337" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc2526gitlab # [ 420.731568] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:04.345Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"f6749b05a22bcb7c7801443b","created_at":"2026-08-15T09:36:00.648Z","trace_propagation_headers":{"sentry-trace":"4f278a50c41c4447b07d7b3783461d75-240f25ba50ae430c","baggage":"sentry-trace_id=4f278a50c41c4447b07d7b3783461d75,sentry-release=Unknown"},"correlation_id":"01M02CBPJ74XHM99VDN0EHZ2K4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:00.659Z","job_size_bytes":66,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-f6749b05a22bcb7c7801443b: done: 0.048769 sec","job_status":"done","queue_duration_s":3.636448,"scheduling_latency_s":3.636465,"redis_calls":10,"redis_duration_s":0.004594,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000332,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0035,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000762,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024669,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00090776,"duration_s":0.048769,"completed_at":"2026-08-15T09:36:04.344Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007358,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2527gitlab # [ 420.780068] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:04.347Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"8d17409ad8580f421cf905a2","created_at":"2026-08-15T09:36:00.661Z","trace_propagation_headers":{"sentry-trace":"4f278a50c41c4447b07d7b3783461d75-240f25ba50ae430c","baggage":"sentry-trace_id=4f278a50c41c4447b07d7b3783461d75,sentry-release=Unknown"},"correlation_id":"01M02CBPJ74XHM99VDN0EHZ2K4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:00.672Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-8d17409ad8580f421cf905a2: start","job_status":"start","queue_duration_s":3.674776,"scheduling_latency_s":3.674802}2528gitlab # [ 420.797232] gitlab-workhorse[821]: time="2026-08-15T09:36:04Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2162529gitlab # [ 420.799142] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:36:04 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 842530gitlab # [ 420.801173] gitaly[900]: time="2026-08-15T09:36:04.350Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=4 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M02CEJ5RG4T5DDFRGJWQWFDK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:36:04.337" grpc.time_ms=13.123 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc2531gitlab # [ 420.815489] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:04.407Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"8d17409ad8580f421cf905a2","created_at":"2026-08-15T09:36:00.661Z","trace_propagation_headers":{"sentry-trace":"4f278a50c41c4447b07d7b3783461d75-240f25ba50ae430c","baggage":"sentry-trace_id=4f278a50c41c4447b07d7b3783461d75,sentry-release=Unknown"},"correlation_id":"01M02CBPJ74XHM99VDN0EHZ2K4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:00.672Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-8d17409ad8580f421cf905a2: done: 0.059759 sec","job_status":"done","queue_duration_s":3.674776,"scheduling_latency_s":3.674802,"redis_calls":10,"redis_duration_s":0.003188,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001045,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001658,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000485,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034805,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025858,"duration_s":0.059759,"completed_at":"2026-08-15T09:36:04.407Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013095,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2532gitlab # [ 420.861538] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:04.412Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"277cad730d5f94775831507b","created_at":"2026-08-15T09:36:00.688Z","trace_propagation_headers":{"sentry-trace":"4f278a50c41c4447b07d7b3783461d75-240f25ba50ae430c","baggage":"sentry-trace_id=4f278a50c41c4447b07d7b3783461d75,sentry-release=Unknown"},"correlation_id":"01M02CBPJ74XHM99VDN0EHZ2K4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:00.699Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-277cad730d5f94775831507b: start","job_status":"start","queue_duration_s":3.713408,"scheduling_latency_s":3.713431}2533gitlab # [ 420.877963] gitaly[900]: time="2026-08-15T09:36:04.469Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=3 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M02CEJ9P1DA57Y5N3CGPWJ0D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:36:04.452" grpc.time_ms=16.9 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc2534gitlab # [ 420.891835] gitaly[900]: time="2026-08-15T09:36:04.559Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M02CEJBVT82JZDBTVSJG3T7M grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:36:04.535" pid=900 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc2535gitlab # [ 420.902247] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:04.453Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"277cad730d5f94775831507b","created_at":"2026-08-15T09:36:00.688Z","trace_propagation_headers":{"sentry-trace":"4f278a50c41c4447b07d7b3783461d75-240f25ba50ae430c","baggage":"sentry-trace_id=4f278a50c41c4447b07d7b3783461d75,sentry-release=Unknown"},"correlation_id":"01M02CBPJ74XHM99VDN0EHZ2K4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:00.699Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-277cad730d5f94775831507b: done: 0.041104 sec","job_status":"done","queue_duration_s":3.713408,"scheduling_latency_s":3.713431,"redis_calls":10,"redis_duration_s":0.001612,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000349,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000918,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000345,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026994,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026976,"duration_s":0.041104,"completed_at":"2026-08-15T09:36:04.453Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00797,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2536gitlab # [ 420.947233] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:04.455Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"86bdfe4727a8544ed7571014","created_at":"2026-08-15T09:36:00.700Z","trace_propagation_headers":{"sentry-trace":"4f278a50c41c4447b07d7b3783461d75-240f25ba50ae430c","baggage":"sentry-trace_id=4f278a50c41c4447b07d7b3783461d75,sentry-release=Unknown"},"correlation_id":"01M02CBPJ74XHM99VDN0EHZ2K4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:00.711Z","job_size_bytes":6,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-86bdfe4727a8544ed7571014: start","job_status":"start","queue_duration_s":3.744246,"scheduling_latency_s":3.744268}2537gitlab # [ 420.964205] gitaly[900]: time="2026-08-15T09:36:04.559Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1101 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=1 command.system_time_ms=15 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M02CEJBVT82JZDBTVSJG3T7M grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:36:04.535" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc2538gitlab # [ 420.979207] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:04.479Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"86bdfe4727a8544ed7571014","created_at":"2026-08-15T09:36:00.700Z","trace_propagation_headers":{"sentry-trace":"4f278a50c41c4447b07d7b3783461d75-240f25ba50ae430c","baggage":"sentry-trace_id=4f278a50c41c4447b07d7b3783461d75,sentry-release=Unknown"},"correlation_id":"01M02CBPJ74XHM99VDN0EHZ2K4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:00.711Z","job_size_bytes":6,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-86bdfe4727a8544ed7571014: done: 0.024314 sec","job_status":"done","queue_duration_s":3.744246,"scheduling_latency_s":3.744268,"redis_calls":10,"redis_duration_s":0.0015170000000000001,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000296,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000919,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000302,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015415,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024366,"duration_s":0.024314,"completed_at":"2026-08-15T09:36:04.479Z","load_balancing_strategy":"primary","db_duration_s":0.001944,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2539gitlab # [ 421.027497] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:04.480Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"308f855d8ded1ce6bd4799bb","created_at":"2026-08-15T09:36:00.712Z","trace_propagation_headers":{"sentry-trace":"4f278a50c41c4447b07d7b3783461d75-240f25ba50ae430c","baggage":"sentry-trace_id=4f278a50c41c4447b07d7b3783461d75,sentry-release=Unknown"},"correlation_id":"01M02CBPJ74XHM99VDN0EHZ2K4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:00.720Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-308f855d8ded1ce6bd4799bb: start","job_status":"start","queue_duration_s":3.760397,"scheduling_latency_s":3.760413}2540gitlab # [ 421.042998] gitaly[900]: time="2026-08-15T09:36:04.560Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1101 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=1 command.system_time_ms=15 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M02CEJBVT82JZDBTVSJG3T7M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:36:04.535" grpc.time_ms=24.653 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc2541gitlab # [ 421.057823] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:04.517Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"308f855d8ded1ce6bd4799bb","created_at":"2026-08-15T09:36:00.712Z","trace_propagation_headers":{"sentry-trace":"4f278a50c41c4447b07d7b3783461d75-240f25ba50ae430c","baggage":"sentry-trace_id=4f278a50c41c4447b07d7b3783461d75,sentry-release=Unknown"},"correlation_id":"01M02CBPJ74XHM99VDN0EHZ2K4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:00.720Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-308f855d8ded1ce6bd4799bb: done: 0.037106 sec","job_status":"done","queue_duration_s":3.760397,"scheduling_latency_s":3.760413,"redis_calls":10,"redis_duration_s":0.001353,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000298,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000774,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000281,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025296,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023432,"duration_s":0.037106,"completed_at":"2026-08-15T09:36:04.517Z","load_balancing_strategy":"primary","db_duration_s":0.006117,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2542gitlab # [ 421.101783] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:04.519Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"9d9b169732914ab94ffdc2d2","created_at":"2026-08-15T09:36:00.731Z","trace_propagation_headers":{"sentry-trace":"4f278a50c41c4447b07d7b3783461d75-240f25ba50ae430c","baggage":"sentry-trace_id=4f278a50c41c4447b07d7b3783461d75,sentry-release=Unknown"},"correlation_id":"01M02CBPJ74XHM99VDN0EHZ2K4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:00.740Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-9d9b169732914ab94ffdc2d2: start","job_status":"start","queue_duration_s":3.778165,"scheduling_latency_s":3.778181}2543gitlab # [ 421.118140] gitaly[900]: time="2026-08-15T09:36:04.643Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CEJFJVXYTZFK4E152RBNM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T09:36:34.642" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:36:04.643" grpc.time_ms=0.55 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2544gitlab # [ 421.131546] nixbot[3476]: {"ts": "2026-08-15T09:36:04.920Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/d0eb289c9176791805276b07dcdcb4ec8ff5e39c \"HTTP/1.1 201 Created\""}2545gitlab # [ 421.134778] nixbot[3476]: {"ts": "2026-08-15T09:36:04.926Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-d0eb289c9176-4"}2546gitlab # [ 421.137135] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:04.593Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"9d9b169732914ab94ffdc2d2","created_at":"2026-08-15T09:36:00.731Z","trace_propagation_headers":{"sentry-trace":"4f278a50c41c4447b07d7b3783461d75-240f25ba50ae430c","baggage":"sentry-trace_id=4f278a50c41c4447b07d7b3783461d75,sentry-release=Unknown"},"correlation_id":"01M02CBPJ74XHM99VDN0EHZ2K4","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:00.740Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-9d9b169732914ab94ffdc2d2: done: 0.074604 sec","job_status":"done","queue_duration_s":3.778165,"scheduling_latency_s":3.778181,"redis_calls":14,"redis_duration_s":0.00368,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000653,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002097,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00093,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050421,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024054,"duration_s":0.074604,"completed_at":"2026-08-15T09:36:04.593Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011838,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2547gitlab # [ 421.181100] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:04.599Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"a0fc1f1220c393cf5d22c37e","created_at":"2026-08-15T09:36:01.037Z","trace_propagation_headers":{"sentry-trace":"9fda4dc3ebae4db3a19528a062575d56-1a7ceab4cbdd453f","baggage":"sentry-trace_id=9fda4dc3ebae4db3a19528a062575d56,sentry-release=Unknown"},"correlation_id":"01M02CBGS014N3S3QNN2N58H0B","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:01.049Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-a0fc1f1220c393cf5d22c37e: start","job_status":"start","queue_duration_s":3.550033,"scheduling_latency_s":3.550082}2548gitlab # [ 421.196749] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:36:04 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 3242549gitlab # [ 421.199193] gitaly[900]: time="2026-08-15T09:36:04.664Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=590 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M02CEJFJVXYTZFK4E152RBNM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-15T09:36:34.651" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T09:36:04.651" grpc.time_ms=12.282 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2550gitlab # [ 421.213131] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:04.687Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"a0fc1f1220c393cf5d22c37e","created_at":"2026-08-15T09:36:01.037Z","trace_propagation_headers":{"sentry-trace":"9fda4dc3ebae4db3a19528a062575d56-1a7ceab4cbdd453f","baggage":"sentry-trace_id=9fda4dc3ebae4db3a19528a062575d56,sentry-release=Unknown"},"correlation_id":"01M02CBGS014N3S3QNN2N58H0B","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:01.049Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-a0fc1f1220c393cf5d22c37e: done: 0.088964 sec","job_status":"done","queue_duration_s":3.550033,"scheduling_latency_s":3.550082,"redis_calls":19,"redis_duration_s":0.005357,"redis_read_bytes":21,"redis_write_bytes":4290,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001192,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000913,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2261,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002263,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000989,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.063105,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01388522,"duration_s":0.088964,"completed_at":"2026-08-15T09:36:04.687Z","load_balancing_strategy":"primary","db_duration_s":0.010635,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2551gitlab # [ 421.258472] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:04.692Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","dfa843e08fc8c3602d605882"],"class":"WebHooks::LogExecutionWorker","jid":"b798cd6ebfef5fe88580ce53","created_at":"2026-08-15T09:36:02.816Z","trace_propagation_headers":{"sentry-trace":"9fda4dc3ebae4db3a19528a062575d56-8e265f00ecb241a3","baggage":"sentry-trace_id=9fda4dc3ebae4db3a19528a062575d56,sentry-release=Unknown"},"correlation_id":"01M02CBGS014N3S3QNN2N58H0B","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b35a46f0b7332831eee41b46342c26e512b212024b5e249dd179113eb71d628e","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:02.828Z","job_size_bytes":2593,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-b798cd6ebfef5fe88580ce53: start","job_status":"start","queue_duration_s":1.863331,"scheduling_latency_s":1.86336}2552gitlab # [ 421.275493] nix-daemon[3683]: accepted connection from pid 4345, user nixbot2553gitlab # [ 421.276463] nix-daemon[3683]: accepted connection from pid 4355, user nixbot2554gitlab # [ 421.277399] gitaly[900]: time="2026-08-15T09:36:04.684Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=6 command.system_time_ms=5 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01M02CEJFJVXYTZFK4E152RBNM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T09:36:14.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T09:36:04.671" grpc.time_ms=13.287 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2555gitlab # [ 421.290971] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:04.759Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","dfa843e08fc8c3602d605882"],"class":"WebHooks::LogExecutionWorker","jid":"b798cd6ebfef5fe88580ce53","created_at":"2026-08-15T09:36:02.816Z","trace_propagation_headers":{"sentry-trace":"9fda4dc3ebae4db3a19528a062575d56-8e265f00ecb241a3","baggage":"sentry-trace_id=9fda4dc3ebae4db3a19528a062575d56,sentry-release=Unknown"},"correlation_id":"01M02CBGS014N3S3QNN2N58H0B","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b35a46f0b7332831eee41b46342c26e512b212024b5e249dd179113eb71d628e","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:02.828Z","job_size_bytes":2593,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-b798cd6ebfef5fe88580ce53: done: 0.068046 sec","job_status":"done","queue_duration_s":1.863331,"scheduling_latency_s":1.86336,"redis_calls":10,"redis_duration_s":0.003728,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001265,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001951,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000512,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050784,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037766,"duration_s":0.068046,"completed_at":"2026-08-15T09:36:04.759Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007471,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2556gitlab # [ 421.335633] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:04.761Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"7bfe45544e44f11215a2d273","created_at":"2026-08-15T09:36:03.623Z","trace_propagation_headers":{"sentry-trace":"18a3915ea2bf4b84a1639271c69d5b6e-90601d5d0b674beb","baggage":"sentry-trace_id=18a3915ea2bf4b84a1639271c69d5b6e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M02CEH7YRD2TKWQQN3QV9T6Y","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:03.635Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-7bfe45544e44f11215a2d273: start","job_status":"start","queue_duration_s":1.12612,"scheduling_latency_s":1.126141}2557gitlab # [ 421.351908] nixbot[3476]: {"ts": "2026-08-15T09:36:05.097Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-d0eb289c9176-4", "argv0": "bwrap"}2558gitlab # [ 421.354460] gitaly[900]: time="2026-08-15T09:36:04.712Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M02CEJFJVXYTZFK4E152RBNM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-15T09:36:14.051" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T09:36:04.711" grpc.time_ms=0.266 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2559gitlab # [ 421.366013] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:05.059Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"7bfe45544e44f11215a2d273","created_at":"2026-08-15T09:36:03.623Z","trace_propagation_headers":{"sentry-trace":"18a3915ea2bf4b84a1639271c69d5b6e-90601d5d0b674beb","baggage":"sentry-trace_id=18a3915ea2bf4b84a1639271c69d5b6e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M02CEH7YRD2TKWQQN3QV9T6Y","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:03.635Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3484,"job_status":"rescheduled","message":"PipelineProcessWorker JID-7bfe45544e44f11215a2d273: rescheduled"}2560gitlab # [ 421.382067] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:05.068Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"7bfe45544e44f11215a2d273","created_at":"2026-08-15T09:36:03.623Z","trace_propagation_headers":{"sentry-trace":"18a3915ea2bf4b84a1639271c69d5b6e-90601d5d0b674beb","baggage":"sentry-trace_id=18a3915ea2bf4b84a1639271c69d5b6e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M02CEH7YRD2TKWQQN3QV9T6Y","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:03.635Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-7bfe45544e44f11215a2d273: done: 0.307117 sec","job_status":"done","queue_duration_s":1.12612,"scheduling_latency_s":1.126141,"gitaly_calls":3,"gitaly_duration_s":0.107729,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.016419,"redis_read_bytes":151,"redis_write_bytes":18015,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000816,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.004353,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.003002,"redis_queues_read_bytes":29,"redis_queues_write_bytes":12314,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.004893,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000229,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000416,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001894,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.045,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.008,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.008,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.03,"db_ci_duration_s":0.015,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.147924,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.261067,"duration_s":0.307117,"completed_at":"2026-08-15T09:36:05.068Z","load_balancing_strategy":"primary","db_duration_s":0.046864,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2561gitlab # [ 421.438022] gitaly[900]: time="2026-08-15T09:36:04.731Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M02CEJFJVXYTZFK4E152RBNM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-15T09:36:14.056" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T09:36:04.716" grpc.time_ms=14.615 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2562gitlab # [ 421.451851] gitaly[900]: time="2026-08-15T09:36:04.791Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M02CEJFJVXYTZFK4E152RBNM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T09:36:04.791" grpc.time_ms=0.584 pid=900 span.kind=server system=grpc2563gitlab # [ 421.462391] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:05.070Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","19f724a09589e5a5d112ab50"],"class":"WebHooks::LogExecutionWorker","jid":"32d45c3d27b1d49b3d30edd7","created_at":"2026-08-15T09:36:03.921Z","trace_propagation_headers":{"sentry-trace":"9b88065261fd48e1acb7f1b5642de805-5d0bba694f1b48c9","baggage":"sentry-trace_id=9b88065261fd48e1acb7f1b5642de805,sentry-release=Unknown"},"correlation_id":"01M02CBNX3C2B3ZSXSHA0B8DDC","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bd5e56567615cbd1478f5cc2dab75f59a9455b89d11eb94f4a07abbf1472c1bf","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:03.927Z","job_size_bytes":2591,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-32d45c3d27b1d49b3d30edd7: start","job_status":"start","queue_duration_s":1.142903,"scheduling_latency_s":1.14293}2564gitlab # [ 421.479816] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:05.114Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","19f724a09589e5a5d112ab50"],"class":"WebHooks::LogExecutionWorker","jid":"32d45c3d27b1d49b3d30edd7","created_at":"2026-08-15T09:36:03.921Z","trace_propagation_headers":{"sentry-trace":"9b88065261fd48e1acb7f1b5642de805-5d0bba694f1b48c9","baggage":"sentry-trace_id=9b88065261fd48e1acb7f1b5642de805,sentry-release=Unknown"},"correlation_id":"01M02CBNX3C2B3ZSXSHA0B8DDC","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bd5e56567615cbd1478f5cc2dab75f59a9455b89d11eb94f4a07abbf1472c1bf","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:03.927Z","job_size_bytes":2591,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-32d45c3d27b1d49b3d30edd7: done: 0.043955 sec","job_status":"done","queue_duration_s":1.142903,"scheduling_latency_s":1.14293,"redis_calls":7,"redis_duration_s":0.002133,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001669,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000464,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.011,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.011,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028557,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.043955,"completed_at":"2026-08-15T09:36:05.114Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009234,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2565gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c'2566gitlab # [ 421.526066] gitaly[900]: time="2026-08-15T09:36:04.821Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M02CEJFJVXYTZFK4E152RBNM grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4156 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T09:36:04.820" grpc.time_ms=0.762 pid=900 span.kind=server system=grpc2567gitlab # [ 421.535534] gitaly[900]: time="2026-08-15T09:36:04.828Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M02CEJFJVXYTZFK4E152RBNM diskcache=2670d2e1-ca00-407d-9412-ccfb532b354d grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-15T09:36:14.073" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T09:36:04.733" pid=900 ref=refs/keep-around/d0eb289c9176791805276b07dcdcb4ec8ff5e39c remote_ip="2001:db8:1::1" revision=d0eb289c9176791805276b07dcdcb4ec8ff5e39c span.kind=server system=grpc username=root2568gitlab # [ 421.546264] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:05.117Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"f2500f3f67ac94a332a9dfbe","created_at":"2026-08-15T09:36:04.661Z","trace_propagation_headers":{"sentry-trace":"9fda4dc3ebae4db3a19528a062575d56-ebbdd920e6774c98","baggage":"sentry-trace_id=9fda4dc3ebae4db3a19528a062575d56,sentry-release=Unknown"},"correlation_id":"01M02CBGS014N3S3QNN2N58H0B","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:04.670Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-f2500f3f67ac94a332a9dfbe: start","job_status":"start","queue_duration_s":0.447184,"scheduling_latency_s":0.447222}2569gitlab # [ 421.561990] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:05.265Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"f2500f3f67ac94a332a9dfbe","created_at":"2026-08-15T09:36:04.661Z","trace_propagation_headers":{"sentry-trace":"9fda4dc3ebae4db3a19528a062575d56-ebbdd920e6774c98","baggage":"sentry-trace_id=9fda4dc3ebae4db3a19528a062575d56,sentry-release=Unknown"},"correlation_id":"01M02CBGS014N3S3QNN2N58H0B","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:04.670Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-f2500f3f67ac94a332a9dfbe: done: 0.147725 sec","job_status":"done","queue_duration_s":0.447184,"scheduling_latency_s":0.447222,"redis_calls":11,"redis_duration_s":0.0037,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000589,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002428,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000683,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.009,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.109459,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00050292,"duration_s":0.147725,"completed_at":"2026-08-15T09:36:05.265Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.03085,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2570gitlab # [ 421.607155] nix-daemon[3683]: accepted connection from pid 4365, user nixbot2571gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c', in 0.09 seconds)2572(finished: subtest: push delivers the webhook, in 96.02 seconds)2573subtest: eval and build post commit statuses2574gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d0eb289c9176791805276b07dcdcb4ec8ff5e39c/statuses2575gitlab # [ 421.608125] gitaly[900]: time="2026-08-15T09:36:04.828Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=86 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5060 command.oublock=8 command.real_time_ms=90 command.spawn_token_fork_ms=6 command.system_time_ms=47 command.user_time_ms=39 component=gitaly.UnaryServerInterceptor correlation_id=01M02CEJFJVXYTZFK4E152RBNM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-15T09:36:14.073" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-15T09:36:04.733" grpc.time_ms=95.384 pid=900 ref=refs/keep-around/d0eb289c9176791805276b07dcdcb4ec8ff5e39c remote_ip="2001:db8:1::1" revision=d0eb289c9176791805276b07dcdcb4ec8ff5e39c span.kind=server system=grpc username=root2576gitlab # [ 421.625544] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:05.267Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"2aeeffb08e9ef7078a78598e","created_at":"2026-08-15T09:36:04.835Z","trace_propagation_headers":{"sentry-trace":"18a3915ea2bf4b84a1639271c69d5b6e-80e1513a8f0b4d27","baggage":"sentry-trace_id=18a3915ea2bf4b84a1639271c69d5b6e,sentry-release=Unknown"},"correlation_id":"01M02CEH7YRD2TKWQQN3QV9T6Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:04.838Z","job_size_bytes":23,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-2aeeffb08e9ef7078a78598e: start","job_status":"start","queue_duration_s":0.429096,"scheduling_latency_s":0.429121}2577gitlab # [ 421.643216] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:05.359Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"2aeeffb08e9ef7078a78598e","created_at":"2026-08-15T09:36:04.835Z","trace_propagation_headers":{"sentry-trace":"18a3915ea2bf4b84a1639271c69d5b6e-80e1513a8f0b4d27","baggage":"sentry-trace_id=18a3915ea2bf4b84a1639271c69d5b6e,sentry-release=Unknown"},"correlation_id":"01M02CEH7YRD2TKWQQN3QV9T6Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:04.838Z","job_size_bytes":23,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-2aeeffb08e9ef7078a78598e: done: 0.092456 sec","job_status":"done","queue_duration_s":0.429096,"scheduling_latency_s":0.429121,"redis_calls":7,"redis_duration_s":0.0028640000000000002,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002033,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000831,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.072659,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.092456,"completed_at":"2026-08-15T09:36:05.359Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015062,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2578gitlab # [ 421.688585] nixbot[3476]: INFO: ::ffff:127.0.0.1:44862 - "GET /api/repos/gitlab/root/test-flake/builds?commit=d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 200 OK2579gitlab # [ 421.690643] gitaly[900]: time="2026-08-15T09:36:04.832Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CEJFJVXYTZFK4E152RBNM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T09:36:34.831" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:36:04.831" grpc.time_ms=0.37 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2580gitlab # [ 421.703888] gitaly[900]: time="2026-08-15T09:36:04.879Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M02CEH7YRD2TKWQQN3QV9T6Y grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T09:36:04.879" grpc.time_ms=0.454 pid=900 span.kind=server system=grpc2581gitlab # [ 421.714305] nix-daemon[3683]: accepted connection from pid 4375, user nixbot2582gitlab # [ 421.715279] nix-daemon[3683]: accepted connection from pid 4365, user nixbot2583gitlab # [ 421.716295] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:05.363Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"b6086ffcb83d0cd7bee3f580","created_at":"2026-08-15T09:36:04.840Z","trace_propagation_headers":{"sentry-trace":"f8ff8e718ec444be920810296ed9aad0-afaf34bf10ad4cb9","baggage":"sentry-trace_id=f8ff8e718ec444be920810296ed9aad0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M02CEJFJVXYTZFK4E152RBNM","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:04.844Z","job_size_bytes":65,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-b6086ffcb83d0cd7bee3f580: start","job_status":"start","queue_duration_s":0.518782,"scheduling_latency_s":0.518825}2584gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d0eb289c9176791805276b07dcdcb4ec8ff5e39c/statuses, in 0.14 seconds)2585gitlab # [ 421.733809] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:05.444Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"b6086ffcb83d0cd7bee3f580","created_at":"2026-08-15T09:36:04.840Z","trace_propagation_headers":{"sentry-trace":"f8ff8e718ec444be920810296ed9aad0-afaf34bf10ad4cb9","baggage":"sentry-trace_id=f8ff8e718ec444be920810296ed9aad0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M02CEJFJVXYTZFK4E152RBNM","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:04.844Z","job_size_bytes":65,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-b6086ffcb83d0cd7bee3f580: done: 0.081185 sec","job_status":"done","queue_duration_s":0.518782,"scheduling_latency_s":0.518825,"redis_calls":7,"redis_duration_s":0.003087,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002093,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000994,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.059078,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.081185,"completed_at":"2026-08-15T09:36:05.444Z","load_balancing_strategy":"primary","db_duration_s":0.009523,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2586gitlab # [ 421.778567] gitaly[900]: time="2026-08-15T09:36:04.909Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M02CEH7YRD2TKWQQN3QV9T6Y grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T09:36:04.909" grpc.time_ms=0.386 pid=900 span.kind=server system=grpc2587gitlab # [ 421.788804] gitaly[900]: time="2026-08-15T09:36:04.936Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M02CEH7YRD2TKWQQN3QV9T6Y grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-15T09:36:04.936" grpc.time_ms=0.572 pid=900 span.kind=server system=grpc2588gitlab # [ 421.799230] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:36:05 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/d0eb289c9176791805276b07dcdcb4ec8ff5e39c/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1032589gitlab # [ 421.802147] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:05.448Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"fb98e801d05f95f83269854d","created_at":"2026-08-15T09:36:04.845Z","trace_propagation_headers":{"sentry-trace":"f8ff8e718ec444be920810296ed9aad0-afaf34bf10ad4cb9","baggage":"sentry-trace_id=f8ff8e718ec444be920810296ed9aad0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M02CEJFJVXYTZFK4E152RBNM","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:04.849Z","job_size_bytes":65,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-fb98e801d05f95f83269854d: start","job_status":"start","queue_duration_s":0.599833,"scheduling_latency_s":0.599872}2590gitlab # [ 421.820326] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:05.613Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"fb98e801d05f95f83269854d","created_at":"2026-08-15T09:36:04.845Z","trace_propagation_headers":{"sentry-trace":"f8ff8e718ec444be920810296ed9aad0-afaf34bf10ad4cb9","baggage":"sentry-trace_id=f8ff8e718ec444be920810296ed9aad0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M02CEJFJVXYTZFK4E152RBNM","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:04.849Z","job_size_bytes":65,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-fb98e801d05f95f83269854d: done: 0.164679 sec","job_status":"done","queue_duration_s":0.599833,"scheduling_latency_s":0.599872,"redis_calls":10,"redis_duration_s":0.005283,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00289,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.002393,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.053,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.044,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.09633,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.164679,"completed_at":"2026-08-15T09:36:05.613Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.05794,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2591gitlab # [ 421.863847] gitaly[900]: time="2026-08-15T09:36:04.943Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M02CEH7YRD2TKWQQN3QV9T6Y diskcache=37d64b36-0876-4be6-b724-bb749cdc6290 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-15T09:36:34.845" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-15T09:36:04.845" pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2592gitlab # [ 421.874687] gitaly[900]: time="2026-08-15T09:36:04.943Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=88 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7069 command.oublock=0 command.real_time_ms=93 command.spawn_token_fork_ms=0 command.system_time_ms=44 command.user_time_ms=44 component=gitaly.UnaryServerInterceptor correlation_id=01M02CEH7YRD2TKWQQN3QV9T6Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-15T09:36:34.845" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T09:36:04.845" grpc.time_ms=97.916 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2593gitlab # [ 421.888242] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:05.615Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"f0004a27b02aea789ee0d4a4","created_at":"2026-08-15T09:36:04.903Z","trace_propagation_headers":{"sentry-trace":"f8ff8e718ec444be920810296ed9aad0-afaf34bf10ad4cb9","baggage":"sentry-trace_id=f8ff8e718ec444be920810296ed9aad0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M02CEJFJVXYTZFK4E152RBNM","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:04.905Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f0004a27b02aea789ee0d4a4: start","job_status":"start","queue_duration_s":0.71002,"scheduling_latency_s":0.710054}2594gitlab # [ 421.903893] gitaly[900]: time="2026-08-15T09:36:04.994Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M02CEH7YRD2TKWQQN3QV9T6Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-15T09:36:34.093" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:36:04.993" grpc.time_ms=0.98 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2595gitlab # [ 421.916507] gitaly[900]: time="2026-08-15T09:36:05.048Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CEH7YRD2TKWQQN3QV9T6Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T09:36:35.045" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:36:05.046" grpc.time_ms=1.873 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2596gitlab # [ 421.928579] gitaly[900]: time="2026-08-15T09:36:05.545Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CEKBGKVE9SGEBFQYD2JFZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T09:36:35.543" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:36:05.544" grpc.time_ms=1.227 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2597gitlab # [ 421.941159] gitaly[900]: time="2026-08-15T09:36:05.726Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M02CEJFJVXYTZFK4E152RBNM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-15T09:36:35.724" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:36:05.725" grpc.time_ms=1.478 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2598gitlab # [ 421.953673] gitaly[900]: time="2026-08-15T09:36:05.781Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CEJFJVXYTZFK4E152RBNM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T09:36:35.779" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:36:05.780" grpc.time_ms=1.151 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2599gitlab # [ 421.965897] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:05.795Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"f0004a27b02aea789ee0d4a4","created_at":"2026-08-15T09:36:04.903Z","trace_propagation_headers":{"sentry-trace":"f8ff8e718ec444be920810296ed9aad0-afaf34bf10ad4cb9","baggage":"sentry-trace_id=f8ff8e718ec444be920810296ed9aad0,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M02CEJFJVXYTZFK4E152RBNM","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:04.905Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f0004a27b02aea789ee0d4a4: done: 0.180485 sec","job_status":"done","queue_duration_s":0.71002,"scheduling_latency_s":0.710054,"gitaly_calls":2,"gitaly_duration_s":0.008563,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.009024,"redis_read_bytes":80,"redis_write_bytes":5121,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001536,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.00133,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000393,"redis_queues_read_bytes":3,"redis_queues_write_bytes":1132,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00214,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000299,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000588,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001202,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.038,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.004,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.007,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.016,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.131295,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.13483064,"duration_s":0.180485,"completed_at":"2026-08-15T09:36:05.795Z","load_balancing_strategy":"primary","db_duration_s":0.041099,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2600gitlab # [ 422.016244] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:05.797Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"deeb88c61008fa6525a16179","created_at":"2026-08-15T09:36:04.948Z","trace_propagation_headers":{"sentry-trace":"18a3915ea2bf4b84a1639271c69d5b6e-80e1513a8f0b4d27","baggage":"sentry-trace_id=18a3915ea2bf4b84a1639271c69d5b6e,sentry-release=Unknown"},"correlation_id":"01M02CEH7YRD2TKWQQN3QV9T6Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:04.950Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-deeb88c61008fa6525a16179: start","job_status":"start","queue_duration_s":0.847421,"scheduling_latency_s":0.84744}2601gitlab # [ 422.032672] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:05.832Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"deeb88c61008fa6525a16179","created_at":"2026-08-15T09:36:04.948Z","trace_propagation_headers":{"sentry-trace":"18a3915ea2bf4b84a1639271c69d5b6e-80e1513a8f0b4d27","baggage":"sentry-trace_id=18a3915ea2bf4b84a1639271c69d5b6e,sentry-release=Unknown"},"correlation_id":"01M02CEH7YRD2TKWQQN3QV9T6Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:04.950Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-deeb88c61008fa6525a16179: done: 0.034924 sec","job_status":"done","queue_duration_s":0.847421,"scheduling_latency_s":0.84744,"redis_calls":7,"redis_duration_s":0.001859,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001364,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000495,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022382,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034924,"completed_at":"2026-08-15T09:36:05.832Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007481,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2602gitlab # [ 422.075082] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:05.834Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"aed3bed2235e5d8df7a0980c","created_at":"2026-08-15T09:36:04.956Z","trace_propagation_headers":{"sentry-trace":"18a3915ea2bf4b84a1639271c69d5b6e-80e1513a8f0b4d27","baggage":"sentry-trace_id=18a3915ea2bf4b84a1639271c69d5b6e,sentry-release=Unknown"},"correlation_id":"01M02CEH7YRD2TKWQQN3QV9T6Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:04.958Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-aed3bed2235e5d8df7a0980c: start","job_status":"start","queue_duration_s":0.875538,"scheduling_latency_s":0.875558}2603gitlab # [ 422.092142] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:05.870Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"aed3bed2235e5d8df7a0980c","created_at":"2026-08-15T09:36:04.956Z","trace_propagation_headers":{"sentry-trace":"18a3915ea2bf4b84a1639271c69d5b6e-80e1513a8f0b4d27","baggage":"sentry-trace_id=18a3915ea2bf4b84a1639271c69d5b6e,sentry-release=Unknown"},"correlation_id":"01M02CEH7YRD2TKWQQN3QV9T6Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:04.958Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-aed3bed2235e5d8df7a0980c: done: 0.036007 sec","job_status":"done","queue_duration_s":0.875538,"scheduling_latency_s":0.875558,"redis_calls":7,"redis_duration_s":0.001973,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001413,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00056,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022811,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.036007,"completed_at":"2026-08-15T09:36:05.870Z","load_balancing_strategy":"primary","db_duration_s":0.008629,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2604gitlab # [ 422.135387] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:05.872Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"cf84c47fe58bab7df8d8d3d2","created_at":"2026-08-15T09:36:04.967Z","trace_propagation_headers":{"sentry-trace":"18a3915ea2bf4b84a1639271c69d5b6e-80e1513a8f0b4d27","baggage":"sentry-trace_id=18a3915ea2bf4b84a1639271c69d5b6e,sentry-release=Unknown"},"correlation_id":"01M02CEH7YRD2TKWQQN3QV9T6Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:04.969Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-cf84c47fe58bab7df8d8d3d2: start","job_status":"start","queue_duration_s":0.902686,"scheduling_latency_s":0.902706}2605gitlab # [ 422.150809] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:05.908Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"cf84c47fe58bab7df8d8d3d2","created_at":"2026-08-15T09:36:04.967Z","trace_propagation_headers":{"sentry-trace":"18a3915ea2bf4b84a1639271c69d5b6e-80e1513a8f0b4d27","baggage":"sentry-trace_id=18a3915ea2bf4b84a1639271c69d5b6e,sentry-release=Unknown"},"correlation_id":"01M02CEH7YRD2TKWQQN3QV9T6Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:04.969Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-cf84c47fe58bab7df8d8d3d2: done: 0.036533 sec","job_status":"done","queue_duration_s":0.902686,"scheduling_latency_s":0.902706,"redis_calls":10,"redis_duration_s":0.002713,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001431,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000781,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000501,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023036,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.036533,"completed_at":"2026-08-15T09:36:05.908Z","load_balancing_strategy":"primary","db_duration_s":0.008483,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2606gitlab # [ 422.194104] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:05.910Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"dfebf664615daee91dd38595","created_at":"2026-08-15T09:36:04.969Z","trace_propagation_headers":{"sentry-trace":"18a3915ea2bf4b84a1639271c69d5b6e-80e1513a8f0b4d27","baggage":"sentry-trace_id=18a3915ea2bf4b84a1639271c69d5b6e,sentry-release=Unknown"},"correlation_id":"01M02CEH7YRD2TKWQQN3QV9T6Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:04.971Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-dfebf664615daee91dd38595: start","job_status":"start","queue_duration_s":0.93866,"scheduling_latency_s":0.93868}2607gitlab # [ 422.211880] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:05.940Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"dfebf664615daee91dd38595","created_at":"2026-08-15T09:36:04.969Z","trace_propagation_headers":{"sentry-trace":"18a3915ea2bf4b84a1639271c69d5b6e-80e1513a8f0b4d27","baggage":"sentry-trace_id=18a3915ea2bf4b84a1639271c69d5b6e,sentry-release=Unknown"},"correlation_id":"01M02CEH7YRD2TKWQQN3QV9T6Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:04.971Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-dfebf664615daee91dd38595: done: 0.030338 sec","job_status":"done","queue_duration_s":0.93866,"scheduling_latency_s":0.93868,"redis_calls":7,"redis_duration_s":0.001977,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001429,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000548,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018893,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030338,"completed_at":"2026-08-15T09:36:05.940Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00693,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2608gitlab # [ 422.254703] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:05.942Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"fd7bdc8616db4d653b1a16bf","created_at":"2026-08-15T09:36:04.972Z","trace_propagation_headers":{"sentry-trace":"18a3915ea2bf4b84a1639271c69d5b6e-80e1513a8f0b4d27","baggage":"sentry-trace_id=18a3915ea2bf4b84a1639271c69d5b6e,sentry-release=Unknown"},"correlation_id":"01M02CEH7YRD2TKWQQN3QV9T6Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:04.974Z","job_size_bytes":19,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-fd7bdc8616db4d653b1a16bf: start","job_status":"start","queue_duration_s":0.967951,"scheduling_latency_s":0.967971}2609gitlab # [ 422.270809] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:05.969Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"fd7bdc8616db4d653b1a16bf","created_at":"2026-08-15T09:36:04.972Z","trace_propagation_headers":{"sentry-trace":"18a3915ea2bf4b84a1639271c69d5b6e-80e1513a8f0b4d27","baggage":"sentry-trace_id=18a3915ea2bf4b84a1639271c69d5b6e,sentry-release=Unknown"},"correlation_id":"01M02CEH7YRD2TKWQQN3QV9T6Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:04.974Z","job_size_bytes":19,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-fd7bdc8616db4d653b1a16bf: done: 0.027083 sec","job_status":"done","queue_duration_s":0.967951,"scheduling_latency_s":0.967971,"redis_calls":8,"redis_duration_s":0.002046,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001564,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000482,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016317,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027083,"completed_at":"2026-08-15T09:36:05.969Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005813,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2610gitlab # [ 422.314767] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:05.970Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"f4287070aa5dd1eab0230668","created_at":"2026-08-15T09:36:04.975Z","trace_propagation_headers":{"sentry-trace":"18a3915ea2bf4b84a1639271c69d5b6e-80e1513a8f0b4d27","baggage":"sentry-trace_id=18a3915ea2bf4b84a1639271c69d5b6e,sentry-release=Unknown"},"correlation_id":"01M02CEH7YRD2TKWQQN3QV9T6Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:04.976Z","job_size_bytes":66,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-f4287070aa5dd1eab0230668: start","job_status":"start","queue_duration_s":0.993731,"scheduling_latency_s":0.993748}2611gitlab # [ 422.332923] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:05.995Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"f4287070aa5dd1eab0230668","created_at":"2026-08-15T09:36:04.975Z","trace_propagation_headers":{"sentry-trace":"18a3915ea2bf4b84a1639271c69d5b6e-80e1513a8f0b4d27","baggage":"sentry-trace_id=18a3915ea2bf4b84a1639271c69d5b6e,sentry-release=Unknown"},"correlation_id":"01M02CEH7YRD2TKWQQN3QV9T6Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:04.976Z","job_size_bytes":66,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-f4287070aa5dd1eab0230668: done: 0.025184 sec","job_status":"done","queue_duration_s":0.993731,"scheduling_latency_s":0.993748,"redis_calls":7,"redis_duration_s":0.001831,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001316,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000515,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016073,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025184,"completed_at":"2026-08-15T09:36:05.995Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004562,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2612gitlab # [ 422.376686] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:05.997Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"6e24d2c5e502e7d3ffe5cd86","created_at":"2026-08-15T09:36:04.977Z","trace_propagation_headers":{"sentry-trace":"18a3915ea2bf4b84a1639271c69d5b6e-80e1513a8f0b4d27","baggage":"sentry-trace_id=18a3915ea2bf4b84a1639271c69d5b6e,sentry-release=Unknown"},"correlation_id":"01M02CEH7YRD2TKWQQN3QV9T6Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:04.978Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-6e24d2c5e502e7d3ffe5cd86: start","job_status":"start","queue_duration_s":1.01836,"scheduling_latency_s":1.018377}2613gitlab # [ 422.393080] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:06.026Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"6e24d2c5e502e7d3ffe5cd86","created_at":"2026-08-15T09:36:04.977Z","trace_propagation_headers":{"sentry-trace":"18a3915ea2bf4b84a1639271c69d5b6e-80e1513a8f0b4d27","baggage":"sentry-trace_id=18a3915ea2bf4b84a1639271c69d5b6e,sentry-release=Unknown"},"correlation_id":"01M02CEH7YRD2TKWQQN3QV9T6Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:04.978Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-6e24d2c5e502e7d3ffe5cd86: done: 0.029478 sec","job_status":"done","queue_duration_s":1.01836,"scheduling_latency_s":1.018377,"redis_calls":7,"redis_duration_s":0.002082,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001477,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000605,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018107,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029478,"completed_at":"2026-08-15T09:36:06.026Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007157,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2614gitlab # [ 422.435798] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:06.028Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"1407b5a8cdc7713e7e877a9e","created_at":"2026-08-15T09:36:04.979Z","trace_propagation_headers":{"sentry-trace":"18a3915ea2bf4b84a1639271c69d5b6e-80e1513a8f0b4d27","baggage":"sentry-trace_id=18a3915ea2bf4b84a1639271c69d5b6e,sentry-release=Unknown"},"correlation_id":"01M02CEH7YRD2TKWQQN3QV9T6Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:04.980Z","job_size_bytes":6,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-1407b5a8cdc7713e7e877a9e: start","job_status":"start","queue_duration_s":1.047651,"scheduling_latency_s":1.047671}2615gitlab # [ 422.451965] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:06.043Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"1407b5a8cdc7713e7e877a9e","created_at":"2026-08-15T09:36:04.979Z","trace_propagation_headers":{"sentry-trace":"18a3915ea2bf4b84a1639271c69d5b6e-80e1513a8f0b4d27","baggage":"sentry-trace_id=18a3915ea2bf4b84a1639271c69d5b6e,sentry-release=Unknown"},"correlation_id":"01M02CEH7YRD2TKWQQN3QV9T6Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:04.980Z","job_size_bytes":6,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-1407b5a8cdc7713e7e877a9e: done: 0.015 sec","job_status":"done","queue_duration_s":1.047651,"scheduling_latency_s":1.047671,"redis_calls":7,"redis_duration_s":0.001676,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001221,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000455,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00949,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015,"completed_at":"2026-08-15T09:36:06.043Z","load_balancing_strategy":"primary","db_duration_s":0.000612,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2616gitlab # [ 422.494223] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:06.045Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"012a96ff0cb8ab438045870a","created_at":"2026-08-15T09:36:04.981Z","trace_propagation_headers":{"sentry-trace":"18a3915ea2bf4b84a1639271c69d5b6e-80e1513a8f0b4d27","baggage":"sentry-trace_id=18a3915ea2bf4b84a1639271c69d5b6e,sentry-release=Unknown"},"correlation_id":"01M02CEH7YRD2TKWQQN3QV9T6Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:04.982Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-012a96ff0cb8ab438045870a: start","job_status":"start","queue_duration_s":1.062099,"scheduling_latency_s":1.062116}2617gitlab # [ 422.509753] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:06.071Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"012a96ff0cb8ab438045870a","created_at":"2026-08-15T09:36:04.981Z","trace_propagation_headers":{"sentry-trace":"18a3915ea2bf4b84a1639271c69d5b6e-80e1513a8f0b4d27","baggage":"sentry-trace_id=18a3915ea2bf4b84a1639271c69d5b6e,sentry-release=Unknown"},"correlation_id":"01M02CEH7YRD2TKWQQN3QV9T6Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:04.982Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-012a96ff0cb8ab438045870a: done: 0.026287 sec","job_status":"done","queue_duration_s":1.062099,"scheduling_latency_s":1.062116,"redis_calls":7,"redis_duration_s":0.001905,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001431,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000474,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016505,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026287,"completed_at":"2026-08-15T09:36:06.071Z","load_balancing_strategy":"primary","db_duration_s":0.005418,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2618gitlab # [ 422.552317] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:06.072Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"8d01e18b3897866026be4d8e","created_at":"2026-08-15T09:36:05.060Z","trace_propagation_headers":{"sentry-trace":"18a3915ea2bf4b84a1639271c69d5b6e-80e1513a8f0b4d27","baggage":"sentry-trace_id=18a3915ea2bf4b84a1639271c69d5b6e,sentry-release=Unknown"},"correlation_id":"01M02CEH7YRD2TKWQQN3QV9T6Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:05.062Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-8d01e18b3897866026be4d8e: start","job_status":"start","queue_duration_s":1.010381,"scheduling_latency_s":1.010398}2619gitlab # [ 422.567751] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:06.101Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"8d01e18b3897866026be4d8e","created_at":"2026-08-15T09:36:05.060Z","trace_propagation_headers":{"sentry-trace":"18a3915ea2bf4b84a1639271c69d5b6e-80e1513a8f0b4d27","baggage":"sentry-trace_id=18a3915ea2bf4b84a1639271c69d5b6e,sentry-release=Unknown"},"correlation_id":"01M02CEH7YRD2TKWQQN3QV9T6Y","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:05.062Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-8d01e18b3897866026be4d8e: done: 0.028519 sec","job_status":"done","queue_duration_s":1.010381,"scheduling_latency_s":1.010398,"redis_calls":8,"redis_duration_s":0.002021,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001576,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000445,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018347,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028519,"completed_at":"2026-08-15T09:36:06.101Z","load_balancing_strategy":"primary","db_duration_s":0.005894,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2620gitlab # [ 422.609951] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:06.102Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"f067c462db5201c945ee012a","created_at":"2026-08-15T09:36:05.702Z","trace_propagation_headers":{"sentry-trace":"f8ff8e718ec444be920810296ed9aad0-52b280ed14474c52","baggage":"sentry-trace_id=f8ff8e718ec444be920810296ed9aad0,sentry-release=Unknown"},"correlation_id":"01M02CEJFJVXYTZFK4E152RBNM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:05.705Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-f067c462db5201c945ee012a: start","job_status":"start","queue_duration_s":0.397592,"scheduling_latency_s":0.397609}2621gitlab # [ 422.626181] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:06.140Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"f067c462db5201c945ee012a","created_at":"2026-08-15T09:36:05.702Z","trace_propagation_headers":{"sentry-trace":"f8ff8e718ec444be920810296ed9aad0-52b280ed14474c52","baggage":"sentry-trace_id=f8ff8e718ec444be920810296ed9aad0,sentry-release=Unknown"},"correlation_id":"01M02CEJFJVXYTZFK4E152RBNM","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:05.705Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-f067c462db5201c945ee012a: done: 0.037333 sec","job_status":"done","queue_duration_s":0.397592,"scheduling_latency_s":0.397609,"redis_calls":7,"redis_duration_s":0.0020670000000000003,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001495,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000572,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025153,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037333,"completed_at":"2026-08-15T09:36:06.140Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007948,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2622gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d0eb289c9176791805276b07dcdcb4ec8ff5e39c/statuses2623gitlab # [ 422.959174] gitaly[900]: time="2026-08-15T09:36:06.797Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CEMH2N5TCF4E6FEX4M49M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T09:36:36.794" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:36:06.795" grpc.time_ms=1.385 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2624gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d0eb289c9176791805276b07dcdcb4ec8ff5e39c/statuses, in 0.25 seconds)2625gitlab # [ 423.014337] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:36:06 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/d0eb289c9176791805276b07dcdcb4ec8ff5e39c/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1622626gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d0eb289c9176791805276b07dcdcb4ec8ff5e39c/statuses2627gitlab # [ 424.190355] gitaly[900]: time="2026-08-15T09:36:08.029Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CENQ4P9B8GZDZKGQGXQ84 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T09:36:38.026" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:36:08.027" grpc.time_ms=1.399 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2628gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d0eb289c9176791805276b07dcdcb4ec8ff5e39c/statuses, in 0.25 seconds)2629gitlab # [ 424.266350] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:36:08 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/d0eb289c9176791805276b07dcdcb4ec8ff5e39c/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1962630gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d0eb289c9176791805276b07dcdcb4ec8ff5e39c/statuses2631gitlab # [ 425.383396] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:09.221Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"e9d1de7464ae692c6b70752c","created_at":"2026-08-15T09:36:09.194Z","trace_propagation_headers":{"sentry-trace":"4e58a7b8574a45a7911e08710377ac4e-b88e3d52a9c8479b","baggage":"sentry-trace_id=4e58a7b8574a45a7911e08710377ac4e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"40167cf2443f7fa287d7fbd5592f4239","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:09.218Z","job_size_bytes":2,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-e9d1de7464ae692c6b70752c: start","job_status":"start","queue_duration_s":0.002732,"scheduling_latency_s":0.002773}2632gitlab # [ 425.432474] gitaly[900]: time="2026-08-15T09:36:09.270Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CEPY9JF3GTBSQ5AVG3MSA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T09:36:39.268" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:36:09.269" grpc.time_ms=1.188 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2633gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d0eb289c9176791805276b07dcdcb4ec8ff5e39c/statuses, in 0.23 seconds)2634gitlab # [ 425.490750] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:36:09 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/d0eb289c9176791805276b07dcdcb4ec8ff5e39c/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1672635gitlab # [ 425.555862] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:09.394Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"e9d1de7464ae692c6b70752c","created_at":"2026-08-15T09:36:09.194Z","trace_propagation_headers":{"sentry-trace":"4e58a7b8574a45a7911e08710377ac4e-b88e3d52a9c8479b","baggage":"sentry-trace_id=4e58a7b8574a45a7911e08710377ac4e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"40167cf2443f7fa287d7fbd5592f4239","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:09.218Z","job_size_bytes":2,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-e9d1de7464ae692c6b70752c: done: 0.172913 sec","job_status":"done","queue_duration_s":0.002732,"scheduling_latency_s":0.002773,"redis_calls":12,"redis_duration_s":0.034235,"redis_read_bytes":10,"redis_write_bytes":1576,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003493,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.020441,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.010301,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.057055,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0201636,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.172913,"completed_at":"2026-08-15T09:36:09.394Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016336,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2636gitlab # [ 425.654161] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:09.404Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"23a3a01b644c6f5536b722c4","created_at":"2026-08-15T09:36:09.235Z","trace_propagation_headers":{"sentry-trace":"4e58a7b8574a45a7911e08710377ac4e-b88e3d52a9c8479b","baggage":"sentry-trace_id=4e58a7b8574a45a7911e08710377ac4e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5ec835a4e9736bad2fbf2682d78e1a68","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:09.252Z","job_size_bytes":2,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-23a3a01b644c6f5536b722c4: start","job_status":"start","queue_duration_s":0.151356,"scheduling_latency_s":0.151404}2637gitlab # [ 425.717210] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:09.555Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"23a3a01b644c6f5536b722c4","created_at":"2026-08-15T09:36:09.235Z","trace_propagation_headers":{"sentry-trace":"4e58a7b8574a45a7911e08710377ac4e-b88e3d52a9c8479b","baggage":"sentry-trace_id=4e58a7b8574a45a7911e08710377ac4e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5ec835a4e9736bad2fbf2682d78e1a68","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:09.252Z","job_size_bytes":2,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-23a3a01b644c6f5536b722c4: done: 0.151269 sec","job_status":"done","queue_duration_s":0.151356,"scheduling_latency_s":0.151404,"redis_calls":11,"redis_duration_s":0.037577,"redis_read_bytes":9,"redis_write_bytes":1464,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.010489,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.017956,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.009132,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039021,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00276266,"exclusive_lock_hold_duration_s":0.01578706,"duration_s":0.151269,"completed_at":"2026-08-15T09:36:09.555Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011359,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2638gitlab # [ 425.813596] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:09.565Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"146c2c0cae3889dbb877affb","created_at":"2026-08-15T09:36:09.286Z","trace_propagation_headers":{"sentry-trace":"4e58a7b8574a45a7911e08710377ac4e-b88e3d52a9c8479b","baggage":"sentry-trace_id=4e58a7b8574a45a7911e08710377ac4e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"80244786ad86d9668edf8ff368ce175e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:09.351Z","job_size_bytes":2,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-146c2c0cae3889dbb877affb: start","job_status":"start","queue_duration_s":0.214104,"scheduling_latency_s":0.214152}2639gitlab # [ 426.451862] gitaly[900]: time="2026-08-15T09:36:10.290Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CEQYA2M7EVN80MFDJRS31 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T09:36:40.287" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:36:10.288" grpc.time_ms=1.159 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2640gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d0eb289c9176791805276b07dcdcb4ec8ff5e39c/statuses2641gitlab # [ 426.532170] gitaly[900]: time="2026-08-15T09:36:10.368Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M02CEQYA2M7EVN80MFDJRS31 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T09:36:20.184" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T09:36:10.355" grpc.time_ms=13.364 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2642gitlab # [ 426.620818] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:10.458Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"146c2c0cae3889dbb877affb","created_at":"2026-08-15T09:36:09.286Z","trace_propagation_headers":{"sentry-trace":"4e58a7b8574a45a7911e08710377ac4e-b88e3d52a9c8479b","baggage":"sentry-trace_id=4e58a7b8574a45a7911e08710377ac4e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"80244786ad86d9668edf8ff368ce175e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:09.351Z","job_size_bytes":2,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-146c2c0cae3889dbb877affb: done: 0.893051 sec","job_status":"done","queue_duration_s":0.214104,"scheduling_latency_s":0.214152,"redis_calls":70,"redis_duration_s":0.424545,"redis_read_bytes":118,"redis_write_bytes":42580,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.017975,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001151,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.398663,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.006756,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.280898,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.893051,"completed_at":"2026-08-15T09:36:10.458Z","load_balancing_strategy":"primary","db_duration_s":0.01338,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2643gitlab # [ 426.682601] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:10.460Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"d14cf90f8a1133784efcea07","created_at":"2026-08-15T09:36:09.383Z","trace_propagation_headers":{"sentry-trace":"4e58a7b8574a45a7911e08710377ac4e-b88e3d52a9c8479b","baggage":"sentry-trace_id=4e58a7b8574a45a7911e08710377ac4e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"57f774fb949dff6248adeaa11cc67bb4","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:09.401Z","job_size_bytes":2,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-d14cf90f8a1133784efcea07: start","job_status":"start","queue_duration_s":1.059215,"scheduling_latency_s":1.059254}2644gitlab # [ 426.697826] gitaly[900]: time="2026-08-15T09:36:10.500Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CER58VWSSS78RK0KTYZTJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T09:36:40.497" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:36:10.498" grpc.time_ms=2.011 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2645gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d0eb289c9176791805276b07dcdcb4ec8ff5e39c/statuses, in 0.22 seconds)2646gitlab # [ 426.711508] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:36:10 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 201 670 "" "python-httpx/0.28.1" 2792647gitlab # [ 426.714176] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:36:10 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/d0eb289c9176791805276b07dcdcb4ec8ff5e39c/statuses HTTP/1.1" 200 672 "" "curl/8.21.0" 1332648gitlab # [ 426.717266] nixbot[3476]: {"ts": "2026-08-15T09:36:10.469Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/d0eb289c9176791805276b07dcdcb4ec8ff5e39c \"HTTP/1.1 201 Created\""}2649gitlab # [ 426.720155] gitaly[900]: time="2026-08-15T09:36:10.539Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CER7AD6DYB6Q6BY4DW8SM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T09:36:40.538" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:36:10.539" grpc.time_ms=0.628 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2650gitlab # [ 426.749011] gitaly[900]: time="2026-08-15T09:36:10.588Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M02CER7AD6DYB6Q6BY4DW8SM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T09:36:20.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T09:36:10.578" grpc.time_ms=10.403 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2651gitlab # [ 426.800882] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:36:10 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 1652652gitlab # [ 426.805397] nixbot[3476]: {"ts": "2026-08-15T09:36:10.641Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/d0eb289c9176791805276b07dcdcb4ec8ff5e39c \"HTTP/1.1 201 Created\""}2653gitlab # [ 426.810049] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:10.645Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"d14cf90f8a1133784efcea07","created_at":"2026-08-15T09:36:09.383Z","trace_propagation_headers":{"sentry-trace":"4e58a7b8574a45a7911e08710377ac4e-b88e3d52a9c8479b","baggage":"sentry-trace_id=4e58a7b8574a45a7911e08710377ac4e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"57f774fb949dff6248adeaa11cc67bb4","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:09.401Z","job_size_bytes":2,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-d14cf90f8a1133784efcea07: done: 0.184591 sec","job_status":"done","queue_duration_s":1.059215,"scheduling_latency_s":1.059254,"redis_calls":9,"redis_duration_s":0.01841,"redis_read_bytes":7,"redis_write_bytes":1183,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.007924,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.007669,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002817,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032666,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.184591,"completed_at":"2026-08-15T09:36:10.645Z","load_balancing_strategy":"primary","db_duration_s":0.02896,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2654gitlab # [ 426.861373] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:10.674Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"e182df37e1536b790051486a","created_at":"2026-08-15T09:36:09.413Z","trace_propagation_headers":{"sentry-trace":"4e58a7b8574a45a7911e08710377ac4e-b88e3d52a9c8479b","baggage":"sentry-trace_id=4e58a7b8574a45a7911e08710377ac4e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c78e289de49108f56fd15ffe5925f984","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:09.428Z","job_size_bytes":2,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-e182df37e1536b790051486a: start","job_status":"start","queue_duration_s":1.246309,"scheduling_latency_s":1.246365}2655gitlab # [ 426.876397] gitaly[900]: time="2026-08-15T09:36:10.707Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CERD07RTX21BH5ZQS6WS1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T09:36:40.705" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:36:10.705" grpc.time_ms=1.221 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2656gitlab # [ 426.902894] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:10.742Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}2657gitlab # [ 426.910171] gitaly[900]: time="2026-08-15T09:36:10.749Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M02CERD07RTX21BH5ZQS6WS1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-15T09:36:20.171" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-15T09:36:10.741" grpc.time_ms=7.69 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2658gitlab # [ 426.927077] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:10.761Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"e182df37e1536b790051486a","created_at":"2026-08-15T09:36:09.413Z","trace_propagation_headers":{"sentry-trace":"4e58a7b8574a45a7911e08710377ac4e-b88e3d52a9c8479b","baggage":"sentry-trace_id=4e58a7b8574a45a7911e08710377ac4e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c78e289de49108f56fd15ffe5925f984","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:09.428Z","job_size_bytes":2,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-e182df37e1536b790051486a: done: 0.087079 sec","job_status":"done","queue_duration_s":1.246309,"scheduling_latency_s":1.246365,"redis_calls":9,"redis_duration_s":0.003531,"redis_read_bytes":7,"redis_write_bytes":1185,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000708,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002119,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000704,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031985,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.087079,"completed_at":"2026-08-15T09:36:10.761Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00061,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2659gitlab # [ 426.975168] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:10.763Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"23ac7d6741b2308ec8a5523f","created_at":"2026-08-15T09:36:09.441Z","trace_propagation_headers":{"sentry-trace":"4e58a7b8574a45a7911e08710377ac4e-b88e3d52a9c8479b","baggage":"sentry-trace_id=4e58a7b8574a45a7911e08710377ac4e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e7340f3ea476385e553ba1a1cbd39702","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:09.465Z","job_size_bytes":2,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-23ac7d6741b2308ec8a5523f: start","job_status":"start","queue_duration_s":1.298513,"scheduling_latency_s":1.298545}2660gitlab # [ 426.989474] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:36:10 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/d0eb289c9176791805276b07dcdcb4ec8ff5e39c HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1522661gitlab # [ 426.992259] nixbot[3476]: {"ts": "2026-08-15T09:36:10.809Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/d0eb289c9176791805276b07dcdcb4ec8ff5e39c \"HTTP/1.1 201 Created\""}2662gitlab # [ 427.083406] nix-daemon[3683]: accepted connection from pid 4435, user nixbot2663gitlab # [ 427.256700] gitaly[900]: time="2026-08-15T09:36:11.095Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M02CERQNY28SS5NVJ5WRNTHT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:36:11.077" grpc.time_ms=17.576 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc2664gitlab # [ 427.289303] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:36:11 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 982665gitlab # [ 427.338493] gitaly[900]: time="2026-08-15T09:36:11.178Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M02CERTS4ME3AY1ETFRHCKWQ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:36:11.165" pid=900 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2666gitlab # [ 427.357108] gitaly[900]: time="2026-08-15T09:36:11.179Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CERTS4ME3AY1ETFRHCKWQ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:36:11.165" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc2667gitlab # [ 427.377945] gitlab-workhorse[821]: time="2026-08-15T09:36:11Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672668gitlab # [ 427.380557] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:36:11 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 822669gitlab # [ 427.383038] gitaly[900]: time="2026-08-15T09:36:11.180Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CERTS4ME3AY1ETFRHCKWQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-15T09:36:11.165" grpc.time_ms=15.076 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc2670gitlab # [ 427.441853] nix-daemon[3683]: accepted connection from pid 4460, user nixbot2671gitlab # [ 427.506661] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:11.345Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"23ac7d6741b2308ec8a5523f","created_at":"2026-08-15T09:36:09.441Z","trace_propagation_headers":{"sentry-trace":"4e58a7b8574a45a7911e08710377ac4e-b88e3d52a9c8479b","baggage":"sentry-trace_id=4e58a7b8574a45a7911e08710377ac4e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e7340f3ea476385e553ba1a1cbd39702","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:09.465Z","job_size_bytes":2,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-23ac7d6741b2308ec8a5523f: done: 0.581879 sec","job_status":"done","queue_duration_s":1.298513,"scheduling_latency_s":1.298545,"redis_calls":564,"redis_duration_s":0.132288,"redis_read_bytes":562,"redis_write_bytes":49063,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000395,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00121,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.130683,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.511105,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.581879,"completed_at":"2026-08-15T09:36:11.345Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003111,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2672gitlab # [ 427.593558] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:11.347Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","jid":"1b2cac9d087efea1d08b4d41","created_at":"2026-08-15T09:36:09.495Z","trace_propagation_headers":{"sentry-trace":"4e58a7b8574a45a7911e08710377ac4e-b88e3d52a9c8479b","baggage":"sentry-trace_id=4e58a7b8574a45a7911e08710377ac4e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ed6c0b2263b9a81e717e8c7df9f17631","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:805014656d48c4962f83ad00758ac8cfab4de244cfbd1d771454e66bd9018911","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:09.515Z","job_size_bytes":2,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker JID-1b2cac9d087efea1d08b4d41: start","job_status":"start","queue_duration_s":1.831807,"scheduling_latency_s":1.831835}2673gitlab # [ 427.613088] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:11.394Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","jid":"1b2cac9d087efea1d08b4d41","created_at":"2026-08-15T09:36:09.495Z","trace_propagation_headers":{"sentry-trace":"4e58a7b8574a45a7911e08710377ac4e-b88e3d52a9c8479b","baggage":"sentry-trace_id=4e58a7b8574a45a7911e08710377ac4e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ed6c0b2263b9a81e717e8c7df9f17631","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:805014656d48c4962f83ad00758ac8cfab4de244cfbd1d771454e66bd9018911","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:09.515Z","job_size_bytes":2,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker JID-1b2cac9d087efea1d08b4d41: done: 0.046915 sec","job_status":"done","queue_duration_s":1.831807,"scheduling_latency_s":1.831835,"redis_calls":20,"redis_duration_s":0.00513,"redis_read_bytes":20,"redis_write_bytes":3248,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002215,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1346,"redis_queues_calls":2,"redis_queues_duration_s":0.000385,"redis_queues_read_bytes":3,"redis_queues_write_bytes":818,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001762,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":734,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000768,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":350,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032086,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00043072,"duration_s":0.046915,"completed_at":"2026-08-15T09:36:11.394Z","load_balancing_strategy":"primary","db_duration_s":0.003064,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2674gitlab # [ 427.671761] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:11.396Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"3a9af6daf8e12a690b72e241","created_at":"2026-08-15T09:36:09.544Z","trace_propagation_headers":{"sentry-trace":"4e58a7b8574a45a7911e08710377ac4e-b88e3d52a9c8479b","baggage":"sentry-trace_id=4e58a7b8574a45a7911e08710377ac4e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6cad904c6e62596cc0a770b645b93f58","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:09.562Z","job_size_bytes":2,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-3a9af6daf8e12a690b72e241: start","job_status":"start","queue_duration_s":1.833437,"scheduling_latency_s":1.833462}2675gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d0eb289c9176791805276b07dcdcb4ec8ff5e39c/statuses2676gitlab # [ 427.692760] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:11.531Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"3a9af6daf8e12a690b72e241","created_at":"2026-08-15T09:36:09.544Z","trace_propagation_headers":{"sentry-trace":"4e58a7b8574a45a7911e08710377ac4e-b88e3d52a9c8479b","baggage":"sentry-trace_id=4e58a7b8574a45a7911e08710377ac4e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6cad904c6e62596cc0a770b645b93f58","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:09.562Z","job_size_bytes":2,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-3a9af6daf8e12a690b72e241: done: 0.134866 sec","job_status":"done","queue_duration_s":1.833437,"scheduling_latency_s":1.833462,"redis_calls":13,"redis_duration_s":0.00567,"redis_read_bytes":11,"redis_write_bytes":1780,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001784,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002211,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001675,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.023,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.095159,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00127604,"exclusive_lock_hold_duration_s":0.08419022,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.134866,"completed_at":"2026-08-15T09:36:11.531Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027245,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2677gitlab # [ 427.740802] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:11.534Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"cb71135156497826f2b5e3c2","created_at":"2026-08-15T09:36:09.580Z","trace_propagation_headers":{"sentry-trace":"4e58a7b8574a45a7911e08710377ac4e-b88e3d52a9c8479b","baggage":"sentry-trace_id=4e58a7b8574a45a7911e08710377ac4e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"76dd4dbf7c2d10ff5729ee4485300c62","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:09.593Z","job_size_bytes":2,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-cb71135156497826f2b5e3c2: start","job_status":"start","queue_duration_s":1.941198,"scheduling_latency_s":1.941232}2678gitlab # [ 427.754912] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:11.581Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"cb71135156497826f2b5e3c2","created_at":"2026-08-15T09:36:09.580Z","trace_propagation_headers":{"sentry-trace":"4e58a7b8574a45a7911e08710377ac4e-b88e3d52a9c8479b","baggage":"sentry-trace_id=4e58a7b8574a45a7911e08710377ac4e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"76dd4dbf7c2d10ff5729ee4485300c62","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:09.593Z","job_size_bytes":2,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-cb71135156497826f2b5e3c2: done: 0.047309 sec","job_status":"done","queue_duration_s":1.941198,"scheduling_latency_s":1.941232,"redis_calls":9,"redis_duration_s":0.003033,"redis_read_bytes":7,"redis_write_bytes":984,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000621,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.0017,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000712,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028655,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.047309,"completed_at":"2026-08-15T09:36:11.581Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004967,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2679gitlab # [ 427.796535] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:11.584Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"bf4660e9d53e3df30e2daf56","created_at":"2026-08-15T09:36:09.602Z","trace_propagation_headers":{"sentry-trace":"4e58a7b8574a45a7911e08710377ac4e-b88e3d52a9c8479b","baggage":"sentry-trace_id=4e58a7b8574a45a7911e08710377ac4e,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"dbe07650de0ee2cc924d8be122ee56a1","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:09.629Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-bf4660e9d53e3df30e2daf56: start","job_status":"start","queue_duration_s":1.955761,"scheduling_latency_s":1.955795}2680gitlab # [ 427.810135] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:11.618Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"bf4660e9d53e3df30e2daf56","created_at":"2026-08-15T09:36:09.602Z","trace_propagation_headers":{"sentry-trace":"4e58a7b8574a45a7911e08710377ac4e-b88e3d52a9c8479b","baggage":"sentry-trace_id=4e58a7b8574a45a7911e08710377ac4e,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"dbe07650de0ee2cc924d8be122ee56a1","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:09.629Z","job_size_bytes":3,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-bf4660e9d53e3df30e2daf56: done: 0.034213 sec","job_status":"done","queue_duration_s":1.955761,"scheduling_latency_s":1.955795,"redis_calls":9,"redis_duration_s":0.002307,"redis_read_bytes":7,"redis_write_bytes":1108,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000481,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001359,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000467,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018529,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034213,"completed_at":"2026-08-15T09:36:11.618Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002833,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2681gitlab # [ 427.853442] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:11.620Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Runners::StaleMachinesCleanupCronWorker","jid":"903225b6f1155e52e8810354","created_at":"2026-08-15T09:36:09.652Z","trace_propagation_headers":{"sentry-trace":"4e58a7b8574a45a7911e08710377ac4e-b88e3d52a9c8479b","baggage":"sentry-trace_id=4e58a7b8574a45a7911e08710377ac4e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"08b4f35c43d789d8a3fe891edcc05953","meta.root_caller_id":"Cronjob","meta.feature_category":"fleet_visibility","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b74a831dd4b14c3fc2b303407a0e209ea633ae1f03f57327e51b9e7be5871f1f","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:09.679Z","job_size_bytes":2,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Runners::StaleMachinesCleanupCronWorker JID-903225b6f1155e52e8810354: start","job_status":"start","queue_duration_s":1.941575,"scheduling_latency_s":1.941598}2682gitlab # [ 427.867881] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:11.669Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Runners::StaleMachinesCleanupCronWorker","jid":"903225b6f1155e52e8810354","created_at":"2026-08-15T09:36:09.652Z","trace_propagation_headers":{"sentry-trace":"4e58a7b8574a45a7911e08710377ac4e-b88e3d52a9c8479b","baggage":"sentry-trace_id=4e58a7b8574a45a7911e08710377ac4e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"08b4f35c43d789d8a3fe891edcc05953","meta.root_caller_id":"Cronjob","meta.feature_category":"fleet_visibility","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b74a831dd4b14c3fc2b303407a0e209ea633ae1f03f57327e51b9e7be5871f1f","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:09.679Z","job_size_bytes":2,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Runners::StaleMachinesCleanupCronWorker JID-903225b6f1155e52e8810354: done: 0.048999 sec","job_status":"done","queue_duration_s":1.941575,"scheduling_latency_s":1.941598,"redis_calls":10,"redis_duration_s":0.002079,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000421,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00117,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000488,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.013,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022687,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00038618,"extra.ci_runners_stale_machines_cleanup_cron_worker.status":"success","extra.ci_runners_stale_machines_cleanup_cron_worker.total_deleted":0,"extra.ci_runners_stale_machines_cleanup_cron_worker.batch_counts":[0],"duration_s":0.048999,"completed_at":"2026-08-15T09:36:11.669Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016133,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2683gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/d0eb289c9176791805276b07dcdcb4ec8ff5e39c/statuses, in 0.21 seconds)2684(finished: subtest: eval and build post commit statuses, in 6.30 seconds)2685(finished: run the VM test script, in 495.58 seconds)2686gitlab # [ 427.912551] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:11.671Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"bfa557d4bcd1bd4847d9fc4f","created_at":"2026-08-15T09:36:09.700Z","trace_propagation_headers":{"sentry-trace":"4e58a7b8574a45a7911e08710377ac4e-b88e3d52a9c8479b","baggage":"sentry-trace_id=4e58a7b8574a45a7911e08710377ac4e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"42eba294fca23e36311c890eafc89113","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:09.735Z","job_size_bytes":2,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-bfa557d4bcd1bd4847d9fc4f: start","job_status":"start","queue_duration_s":1.936155,"scheduling_latency_s":1.93618}2687gitlab # [ 427.926774] gitaly[900]: time="2026-08-15T09:36:11.706Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M02CESAZKY2RRT314P32FKH6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-15T09:36:41.704" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-15T09:36:11.705" grpc.time_ms=1.238 pid=900 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2688gitlab # [ 427.940089] gitlab-workhorse[821]: gitlab 2001:db8:1::1 - - [2026/08/15:09:36:11 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/d0eb289c9176791805276b07dcdcb4ec8ff5e39c/statuses HTTP/1.1" 200 1329 "" "curl/8.21.0" 1322689test script finished in 495.62s2690cleanup2691kill QemuMachine (pid 46)2692gitlab # [ 427.943838] sidekiq-cluster[3484]: {"severity":"INFO","time":"2026-08-15T09:36:11.703Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"bfa557d4bcd1bd4847d9fc4f","created_at":"2026-08-15T09:36:09.700Z","trace_propagation_headers":{"sentry-trace":"4e58a7b8574a45a7911e08710377ac4e-b88e3d52a9c8479b","baggage":"sentry-trace_id=4e58a7b8574a45a7911e08710377ac4e,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"42eba294fca23e36311c890eafc89113","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-15T09:36:09.735Z","job_size_bytes":2,"pid":3484,"sidekiq_tid":"m8s4","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-bfa557d4bcd1bd4847d9fc4f: done: 0.031971 sec","job_status":"done","queue_duration_s":1.936155,"scheduling_latency_s":1.93618,"redis_calls":11,"redis_duration_s":0.002235,"redis_read_bytes":9,"redis_write_byqemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/41m77i1296n33p6liin8ynr6wh3h6b7m-python3-3.14.6/bin/python3.14)2693(finished: cleanup, in 1.27 seconds)2694additionally exposed symbols:2695 gitlab,2696 vlan1,2697 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2698[]2699[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-08-15T09:34:28.520Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2700[]2701[]2702[]2703[]2704[]2705[]2706[]2707[]2708[]2709[]2710[]2711[]2712[]2713[]2714[]2715[]2716[]2717[]2718[]2719[]2720[]2721[]2722[]2723[]2724[]2725[]2726[]2727[]2728[]2729[]2730[]2731[]2732[]2733[]2734[]2735[]2736[]2737[]2738[]2739[]2740[]2741[]2742[]2743[]2744[]2745[]2746[]2747[]2748[]2749[]2750[]2751[]2752[]2753[]2754[]2755[]2756[]2757[]2758[]2759[]2760[]2761[]2762[]2763[]2764[]2765[]2766[]2767[]2768[]2769[]2770[]2771[]2772[]2773[]2774[]2775[]2776[]2777[]2778[]2779[]2780[]2781[]2782[]2783[]2784[]2785[]2786[]2787[]2788[]2789[]2790[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': 'd0eb289c9176791805276b07dcdcb4ec8ff5e39c', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': [{'level': 'warning', 'message': "could not read HEAD ref from repo at '/var/lib/nixbot/worktrees/1-d0eb289c9176-4', using 'master'", 'count': 1}], 'error': None, 'created_at': '2026-08-15T09:36:04.589838Z', 'started_at': '2026-08-15T09:36:04.922376Z', 'finished_at': None}]2791[{'id': 5, 'sha': 'd0eb289c9176791805276b07dcdcb4ec8ff5e39c', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-15T09:36:04.896Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2792[{'id': 5, 'sha': 'd0eb289c9176791805276b07dcdcb4ec8ff5e39c', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-15T09:36:04.896Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2793[{'id': 5, 'sha': 'd0eb289c9176791805276b07dcdcb4ec8ff5e39c', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-15T09:36:04.896Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2794[{'id': 5, 'sha': 'd0eb289c9176791805276b07dcdcb4ec8ff5e39c', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-15T09:36:04.896Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2795[{'id': 5, 'sha': 'd0eb289c9176791805276b07dcdcb4ec8ff5e39c', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (2 warnings)', 'created_at': '2026-08-15T09:36:04.896Z', 'started_at': None, 'finished_at': '2026-08-15T09:36:10.425Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2796[{'id': 5, 'sha': 'd0eb289c9176791805276b07dcdcb4ec8ff5e39c', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (2 warnings)', 'created_at': '2026-08-15T09:36:04.896Z', 'started_at': None, 'finished_at': '2026-08-15T09:36:10.425Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': 'd0eb289c9176791805276b07dcdcb4ec8ff5e39c', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '0 attributes built', 'created_at': '2026-08-15T09:36:10.615Z', 'started_at': None, 'finished_at': '2026-08-15T09:36:10.778Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]