vm-test-run-nixbot-gitlab
checks.aarch64-linux.nixbot-gitlab
· build #200
· raw
1tribuchet: building on eliza2Machine state will be reset. To keep it, pass --keep-machine-state3start all VLans4(finished: start all VLans, in 0.00 seconds)5Test will time out and terminate in 3600 seconds6run the VM test script7start all VMs8gitlab: starting vm9gitlab # Disk image does not exist, creating the virtualisation disk image...10gitlab: QEMU running (pid 46)11gitlab # Formatting '/build/vm-state-gitlab/tmp.PZEr7oXjJm', fmt=raw size=107374182412gitlab # mke2fs 1.47.4 (6-Mar-2025)13gitlab # Discarding device blocks: 0/262144 done14(finished: start all VMs, in 67.92 seconds)15gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes16gitlab: waiting for unit setup-gitlab.service17gitlab # Filesystem UUID: 2e6bc365-09fa-4204-bc2f-7471b33647c418gitlab: waiting for the VM to finish booting19gitlab # Superblock backups stored on blocks:20gitlab # 32768, 98304, 163840, 22937621gitlab # 22gitlab # Allocating group tables: 0/8 done23gitlab # Writing inode tables: 0/8 done24gitlab # Creating journal (8192 blocks): done25gitlab # Writing superblocks and filesystem accounting information: 0/8 done26gitlab # 27gitlab # Virtualisation disk image created.28gitlab # Creating Nix store image...29gitlab # Created Nix store image.30gitlab # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]31gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Thu Aug 6 17:27:09 UTC 202632gitlab # [ 0.000000] KASLR enabled33gitlab # [ 0.000000] random: crng init done34gitlab # [ 0.000000] Machine model: linux,dummy-virt35gitlab # [ 0.000000] efi: UEFI not found.36gitlab # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT37gitlab # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff]38gitlab # [ 0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf]39gitlab # [ 0.000000] Zone ranges:40gitlab # [ 0.000000] DMA [mem 0x0000000040000000-0x00000000ffffffff]41gitlab # [ 0.000000] DMA32 empty42gitlab # [ 0.000000] Normal [mem 0x0000000100000000-0x00000001bfffffff]43gitlab # [ 0.000000] Device empty44gitlab # [ 0.000000] Movable zone start for each node45gitlab # [ 0.000000] Early memory node ranges46gitlab # [ 0.000000] node 0: [mem 0x0000000040000000-0x00000001bfffffff]47gitlab # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff]48gitlab # [ 0.000000] cma: Reserved 32 MiB at 0x00000000fe00000049gitlab # [ 0.000000] psci: probing for conduit method from DT.50gitlab # [ 0.000000] psci: PSCIv1.3 detected in firmware.51gitlab # [ 0.000000] psci: Using standard PSCI v0.2 function IDs52gitlab # [ 0.000000] psci: Trusted OS migration not required53gitlab # [ 0.000000] psci: SMC Calling Convention v1.154gitlab # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)55gitlab # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u31129656gitlab # [ 0.000000] Detected PIPT I-cache on CPU057gitlab # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)58gitlab # [ 0.000000] CPU features: detected: GICv3 CPU interface59gitlab # [ 0.000000] CPU features: detected: Spectre-v460gitlab # [ 0.000000] CPU features: detected: Spectre-BHB61gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_3862gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_2363gitlab # [ 0.000000] alternatives: applying boot alternatives64gitlab # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/yxp8b3cl0ya2z54s70kcr7qszy6xwy14-nixos-system-gitlab-test/init regInfo=/nix/store/sxw4ariqmzv70qwrvqc6wph4sq8w9xac-closure-info/registration console=ttyAMA0,115200n8 console=tty065gitlab # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/sxw4ariqmzv70qwrvqc6wph4sq8w9xac-closure-info/registration", will be passed to user space.66gitlab # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes67gitlab # [ 0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)68gitlab # [ 0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)69gitlab # [ 0.000000] software IO TLB: area num 4.70gitlab # [ 0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB)71gitlab # [ 0.000000] Fallback order for Node 0: 072gitlab # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 157286473gitlab # [ 0.000000] Policy zone: Normal74gitlab # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off75gitlab # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=176gitlab # [ 0.000000] allocated 12582912 bytes of page_ext77gitlab # [ 0.000000] ftrace: allocating 74867 entries in 294 pages78gitlab # [ 0.000000] ftrace: allocated 294 pages with 4 groups79gitlab # [ 0.000000] rcu: Hierarchical RCU implementation.80gitlab # [ 0.000000] rcu: RCU event tracing is enabled.81gitlab # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.82gitlab # [ 0.000000] Trampoline variant of Tasks RCU enabled.83gitlab # [ 0.000000] Rude variant of Tasks RCU enabled.84gitlab # [ 0.000000] Tracing variant of Tasks RCU enabled.85gitlab # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.86gitlab # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=487gitlab # [ 0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.88gitlab # [ 0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.89gitlab # [ 0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.90gitlab # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 091gitlab # [ 0.000000] GICv3: 256 SPIs implemented92gitlab # [ 0.000000] GICv3: 0 Extended SPIs implemented93gitlab # [ 0.000000] Root IRQ handler: gic_handle_irq94gitlab # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI95gitlab # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=096gitlab # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a000097gitlab # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]98gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f10000 (indirect, esz 8, psz 64K, shr 1)99gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f20000 (flat, esz 8, psz 64K, shr 1)100gitlab # [ 0.000000] GICv3: using LPI property table @0x0000000100f30000101gitlab # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f40000102gitlab # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.103gitlab # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns104gitlab # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).105gitlab # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns106gitlab # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns107gitlab # [ 0.000027] arm-pv: using stolen time PV108gitlab # [ 0.000384] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)109gitlab # [ 0.000555] Console: colour dummy device 80x25110gitlab # [ 0.000562] printk: legacy console [tty0] enabled111gitlab # [ 0.000737] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)112gitlab # [ 0.000743] pid_max: default: 32768 minimum: 301113gitlab # [ 0.000812] LSM: initializing lsm=capability,landlock,yama,bpf,ima114gitlab # [ 0.000951] landlock: Up and running.115gitlab # [ 0.000954] Yama: becoming mindful.116gitlab # [ 0.001394] LSM support for eBPF active117gitlab # [ 0.001585] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)118gitlab # [ 0.001682] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)119gitlab # [ 0.002834] cacheinfo: Unable to detect cache hierarchy for CPU 0120gitlab # [ 0.003499] rcu: Hierarchical SRCU implementation.121gitlab # [ 0.003503] rcu: Max phase no-delay instances is 1000.122gitlab # [ 0.003659] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level123gitlab # [ 0.004652] fsl-mc MSI: its@8080000 domain created124gitlab # [ 0.004745] EFI services will not be available.125gitlab # [ 0.004906] smp: Bringing up secondary CPUs ...126gitlab # [ 0.005514] Detected PIPT I-cache on CPU1127gitlab # [ 0.005611] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000128gitlab # [ 0.005733] GICv3: CPU1: using allocated LPI pending table @0x0000000100f50000129gitlab # [ 0.005854] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40]130gitlab # [ 0.006913] Detected PIPT I-cache on CPU2131gitlab # [ 0.007038] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000132gitlab # [ 0.007159] GICv3: CPU2: using allocated LPI pending table @0x0000000100f60000133gitlab # [ 0.007283] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40]134gitlab # [ 0.008330] Detected PIPT I-cache on CPU3135gitlab # [ 0.008444] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000136gitlab # [ 0.008566] GICv3: CPU3: using allocated LPI pending table @0x0000000100f70000137gitlab # [ 0.008686] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40]138gitlab # [ 0.009178] smp: Brought up 1 node, 4 CPUs139gitlab # [ 0.009205] SMP: Total of 4 processors activated.140gitlab # [ 0.009207] CPU: All CPU(s) started at EL1141gitlab # [ 0.009218] CPU features: detected: Branch Target Identification142gitlab # [ 0.009222] CPU features: detected: ARMv8.4 Translation Table Level143gitlab # [ 0.009225] CPU features: detected: Instruction cache invalidation not required for I/D coherence144gitlab # [ 0.009229] CPU features: detected: Data cache clean to the PoU not required for I/D coherence145gitlab # [ 0.009232] CPU features: detected: Common not Private translations146gitlab # [ 0.009235] CPU features: detected: CRC32 instructions147gitlab # [ 0.009238] CPU features: detected: Data cache clean to Point of Deep Persistence148gitlab # [ 0.009241] CPU features: detected: Data cache clean to Point of Persistence149gitlab # [ 0.009244] CPU features: detected: Data independent timing control (DIT)150gitlab # [ 0.009247] CPU features: detected: E0PD151gitlab # [ 0.009250] CPU features: detected: Enhanced Counter Virtualization152gitlab # [ 0.009253] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)153gitlab # [ 0.009256] CPU features: detected: Enhanced Virtualization Traps154gitlab # [ 0.009259] CPU features: detected: Fine Grained Traps155gitlab # [ 0.009263] CPU features: detected: Generic authentication (architected QARMA5 algorithm)156gitlab # [ 0.009267] CPU features: detected: RCpc load-acquire (LDAPR)157gitlab # [ 0.009270] CPU features: detected: LSE atomic instructions158gitlab # [ 0.009273] CPU features: detected: Privileged Access Never159gitlab # [ 0.009276] CPU features: detected: PMUv3160gitlab # [ 0.009278] CPU features: detected: RAS Extension Support161gitlab # [ 0.009281] CPU features: detected: RASv1p1 Extension Support162gitlab # [ 0.009284] CPU features: detected: Random Number Generator163gitlab # [ 0.009286] CPU features: detected: Speculation barrier (SB)164gitlab # [ 0.009289] CPU features: detected: Stage-2 Force Write-Back165gitlab # [ 0.009292] CPU features: detected: TLB range maintenance instructions166gitlab # [ 0.009296] CPU features: detected: Speculative Store Bypassing Safe (SSBS)167gitlab # [ 0.009422] alternatives: applying system-wide alternatives168gitlab # [ 0.012262] CPU features: detected: BBM Level 2 without TLB conflict abort169gitlab # [ 0.012463] Memory: 5963804K/6291456K available (24448K kernel code, 7090K rwdata, 26340K rodata, 4736K init, 1106K bss, 272908K reserved, 32768K cma-reserved)170gitlab # [ 0.013967] devtmpfs: initialized171gitlab # [ 0.017975] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)172gitlab # [ 0.018040] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).173gitlab # [ 0.018216] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL174gitlab # [ 0.018221] 0 pages in range for non-PLT usage175gitlab # [ 0.018222] 508288 pages in range for PLT usage176gitlab # [ 0.018334] pinctrl core: initialized pinctrl subsystem177gitlab # [ 0.019104] DMI not present or invalid.178gitlab # [ 0.022263] NET: Registered PF_NETLINK/PF_ROUTE protocol family179gitlab # [ 0.024567] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations180gitlab # [ 0.024832] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations181gitlab # [ 0.026718] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations182gitlab # [ 0.026739] audit: initializing netlink subsys (disabled)183gitlab # [ 0.027108] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1184gitlab # [ 0.027560] thermal_sys: Registered thermal governor 'fair_share'185gitlab # [ 0.027563] thermal_sys: Registered thermal governor 'bang_bang'186gitlab # [ 0.027567] thermal_sys: Registered thermal governor 'step_wise'187gitlab # [ 0.027570] thermal_sys: Registered thermal governor 'user_space'188gitlab # [ 0.027573] thermal_sys: Registered thermal governor 'power_allocator'189gitlab # [ 0.027651] cpuidle: using governor ladder190gitlab # [ 0.027673] cpuidle: using governor menu191gitlab # [ 0.027870] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.192gitlab # [ 0.028074] ASID allocator initialised with 65536 entries193gitlab # [ 0.029234] Serial: AMBA PL011 UART driver194gitlab # [ 0.034412] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1195gitlab # [ 0.034704] printk: console [ttyAMA0] enabled196gitlab # [ 0.046872] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages197gitlab # [ 0.046891] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page198gitlab # [ 0.046901] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages199gitlab # [ 0.046909] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page200gitlab # [ 0.046918] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages201gitlab # [ 0.046925] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page202gitlab # [ 0.046934] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages203gitlab # [ 0.046941] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page204gitlab # [ 0.058544] fbcon: Taking over console205gitlab # [ 0.058554] ACPI: Interpreter disabled.206gitlab # [ 0.059563] iommu: Default domain type: Translated207gitlab # [ 0.059579] iommu: DMA domain TLB invalidation policy: strict mode208gitlab # [ 0.069351] SCSI subsystem initialized209gitlab # [ 0.069745] usbcore: registered new interface driver usbfs210gitlab # [ 0.069779] usbcore: registered new interface driver hub211gitlab # [ 0.069796] usbcore: registered new device driver usb212gitlab # [ 0.070077] pps_core: LinuxPPS API ver. 1 registered213gitlab # [ 0.070081] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>214gitlab # [ 0.070090] PTP clock support registered215gitlab # [ 0.070135] EDAC MC: Ver: 3.0.0216gitlab # [ 0.070642] scmi_core: SCMI protocol bus registered217gitlab # [ 0.071588] FPGA manager framework218gitlab # [ 0.072305] vgaarb: loaded219gitlab # [ 0.074321] clocksource: Switched to clocksource arch_sys_counter220gitlab # [ 0.074795] VFS: Disk quotas dquot_6.6.0221gitlab # [ 0.074821] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)222gitlab # [ 0.077063] netfs: FS-Cache loaded223gitlab # [ 0.077169] pnp: PnP ACPI: disabled224gitlab # [ 0.085753] NET: Registered PF_INET protocol family225gitlab # [ 0.086649] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)226gitlab # [ 0.114175] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)227gitlab # [ 0.114221] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)228gitlab # [ 0.114261] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)229gitlab # [ 0.114549] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)230gitlab # [ 0.115104] TCP: Hash tables configured (established 65536 bind 65536)231gitlab # [ 0.115389] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)232gitlab # [ 0.115619] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)233gitlab # [ 0.115909] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)234gitlab # [ 0.116092] NET: Registered PF_UNIX/PF_LOCAL protocol family235gitlab # [ 0.116109] NET: Registered PF_XDP protocol family236gitlab # [ 0.116122] PCI: CLS 0 bytes, default 64237gitlab # [ 0.116393] Trying to unpack rootfs image as initramfs...238gitlab # [ 0.126517] kvm [1]: HYP mode not available239gitlab # [ 0.210909] Initialise system trusted keyrings240gitlab # [ 0.211205] workingset: timestamp_bits=42 max_order=21 bucket_order=0241gitlab # [ 0.212038] squashfs: version 4.0 (2009/01/31) Phillip Lougher242gitlab # [ 0.212108] 9p: Installing v9fs 9p2000 file system support243gitlab # [ 0.228844] Key type asymmetric registered244gitlab # [ 0.228850] Asymmetric key parser 'x509' registered245gitlab # [ 0.228964] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)246gitlab # [ 0.229235] io scheduler mq-deadline registered247gitlab # [ 0.229242] io scheduler kyber registered248gitlab # [ 0.241157] pl061_gpio 9030000.pl061: PL061 GPIO chip registered249gitlab # [ 0.246422] ledtrig-cpu: registered to indicate activity on CPUs250gitlab # [ 0.247116] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:251gitlab # [ 0.247140] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000252gitlab # [ 0.247163] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000253gitlab # [ 0.247174] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000254gitlab # [ 0.247194] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits255gitlab # [ 0.247231] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]256gitlab # [ 0.247388] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00257gitlab # [ 0.247400] pci_bus 0000:00: root bus resource [bus 00-ff]258gitlab # [ 0.247407] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]259gitlab # [ 0.247413] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]260gitlab # [ 0.247419] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]261gitlab # [ 0.247516] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint262gitlab # [ 0.248491] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint263gitlab # [ 0.248921] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]264gitlab # [ 0.248944] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]265gitlab # [ 0.248990] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]266gitlab # [ 0.249012] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]267gitlab # [ 0.249985] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint268gitlab # [ 0.250438] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]269gitlab # [ 0.250459] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]270gitlab # [ 0.250519] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]271gitlab # [ 0.251472] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint272gitlab # [ 0.251868] pci 0000:00:03.0: BAR 0 [io 0x0000-0x001f]273gitlab # [ 0.251890] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]274gitlab # [ 0.251945] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]275gitlab # [ 0.252918] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint276gitlab # [ 0.253321] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]277gitlab # [ 0.253342] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]278gitlab # [ 0.253395] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]279gitlab # [ 0.254323] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint280gitlab # [ 0.254708] pci 0000:00:05.0: BAR 0 [io 0x0000-0x007f]281gitlab # [ 0.254728] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]282gitlab # [ 0.254782] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]283gitlab # [ 0.255696] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint284gitlab # [ 0.256097] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]285gitlab # [ 0.256118] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]286gitlab # [ 0.256173] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]287gitlab # [ 0.257103] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint288gitlab # [ 0.257500] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]289gitlab # [ 0.257522] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]290gitlab # [ 0.257569] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]291gitlab # [ 0.257591] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]292gitlab # [ 0.258538] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint293gitlab # [ 0.258943] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]294gitlab # [ 0.258999] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]295gitlab # [ 0.260027] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint296gitlab # [ 0.260454] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]297gitlab # [ 0.260501] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]298gitlab # [ 0.261316] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint299gitlab # [ 0.261717] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]300gitlab # [ 0.262208] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint301gitlab # [ 0.262666] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]302gitlab # [ 0.262687] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]303gitlab # [ 0.262741] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]304gitlab # [ 0.263699] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint305gitlab # [ 0.264106] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]306gitlab # [ 0.264127] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]307gitlab # [ 0.264181] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]308gitlab # [ 0.265324] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned309gitlab # [ 0.265335] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned310gitlab # [ 0.265342] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned311gitlab # [ 0.265427] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned312gitlab # [ 0.265511] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned313gitlab # [ 0.265588] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned314gitlab # [ 0.265673] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned315gitlab # [ 0.265761] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned316gitlab # [ 0.265846] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned317gitlab # [ 0.265934] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned318gitlab # [ 0.266018] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned319gitlab # [ 0.266112] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned320gitlab # [ 0.266235] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned321gitlab # [ 0.266320] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned322gitlab # [ 0.266378] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned323gitlab # [ 0.266409] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned324gitlab # [ 0.266441] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned325gitlab # [ 0.266472] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned326gitlab # [ 0.266505] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned327gitlab # [ 0.266544] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned328gitlab # [ 0.266576] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned329gitlab # [ 0.266609] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned330gitlab # [ 0.266651] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned331gitlab # [ 0.266684] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned332gitlab # [ 0.266725] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned333gitlab # [ 0.266762] pci 0000:00:05.0: BAR 0 [io 0x1000-0x107f]: assigned334gitlab # [ 0.266793] pci 0000:00:06.0: BAR 0 [io 0x1080-0x10ff]: assigned335gitlab # [ 0.266823] pci 0000:00:0b.0: BAR 0 [io 0x1100-0x113f]: assigned336gitlab # [ 0.266854] pci 0000:00:01.0: BAR 0 [io 0x1140-0x115f]: assigned337gitlab # [ 0.266884] pci 0000:00:02.0: BAR 0 [io 0x1160-0x117f]: assigned338gitlab # [ 0.266925] pci 0000:00:03.0: BAR 0 [io 0x1180-0x119f]: assigned339gitlab # [ 0.266965] pci 0000:00:04.0: BAR 0 [io 0x11a0-0x11bf]: assigned340gitlab # [ 0.266999] pci 0000:00:07.0: BAR 0 [io 0x11c0-0x11df]: assigned341gitlab # [ 0.267030] pci 0000:00:0c.0: BAR 0 [io 0x11e0-0x11ff]: assigned342gitlab # [ 0.267076] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]343gitlab # [ 0.267085] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]344gitlab # [ 0.267090] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]345gitlab # [ 0.269667] pci 0000:00:0a.0: enabling device (0000 -> 0002)346gitlab # [ 0.288556] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)347gitlab # [ 0.291606] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)348gitlab # [ 0.294575] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)349gitlab # [ 0.297582] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)350gitlab # [ 0.303425] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)351gitlab # [ 0.306475] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)352gitlab # [ 0.309238] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)353gitlab # [ 0.312278] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)354gitlab # [ 0.317883] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)355gitlab # [ 0.320805] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)356gitlab # [ 0.324373] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)357gitlab # [ 0.332445] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled358gitlab # [ 0.334918] msm_serial: driver initialized359gitlab # [ 0.335200] SuperH (H)SCI(F) driver initialized360gitlab # [ 0.335272] STM32 USART driver initialized361gitlab # [ 0.362846] loop: module loaded362gitlab # [ 0.363215] virtio_blk virtio4: 4/0/0 default/read/poll queues363gitlab # [ 0.365665] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)364gitlab # [ 0.368000] virtio_blk virtio5: 4/0/0 default/read/poll queues365gitlab # [ 0.370157] virtio_blk virtio5: [vdb] 12204064 512-byte logical blocks (6.25 GB/5.82 GiB)366gitlab # [ 0.372714] megasas: 07.734.00.00-rc1367gitlab # [ 0.373713] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]368gitlab # [ 0.381323] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000369gitlab # [ 0.381342] Intel/Sharp Extended Query Table at 0x0031370gitlab # [ 0.383577] Using buffer write method371gitlab # [ 0.383637] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]372gitlab # [ 0.386133] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000373gitlab # [ 0.386150] Intel/Sharp Extended Query Table at 0x0031374gitlab # [ 0.388457] Using buffer write method375gitlab # [ 0.388475] Concatenating MTD devices:376gitlab # [ 0.388478] (0): "0.flash"377gitlab # [ 0.388481] (1): "0.flash"378gitlab # [ 0.388484] into device "0.flash"379gitlab # [ 0.548189] Freeing initrd memory: 27184K380gitlab # [ 0.565470] tun: Universal TUN/TAP device driver, 1.6381gitlab # [ 0.573712] thunder_xcv, ver 1.0382gitlab # [ 0.573842] thunder_bgx, ver 1.0383gitlab # [ 0.573905] nicpf, ver 1.0384gitlab # [ 0.575588] e1000: Intel(R) PRO/1000 Network Driver385gitlab # [ 0.575599] e1000: Copyright (c) 1999-2006 Intel Corporation.386gitlab # [ 0.575665] e1000e: Intel(R) PRO/1000 Network Driver387gitlab # [ 0.575680] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.388gitlab # [ 0.575760] igb: Intel(R) Gigabit Ethernet Network Driver389gitlab # [ 0.575769] igb: Copyright (c) 2007-2014 Intel Corporation.390gitlab # [ 0.575831] igbvf: Intel(R) Gigabit Virtual Function Network Driver391gitlab # [ 0.575840] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.392gitlab # [ 0.576273] sky2: driver version 1.30393gitlab # [ 0.581130] usbcore: registered new interface driver usb-storage394gitlab # [ 0.581508] usbcore: registered new interface driver usbserial_generic395gitlab # [ 0.581550] usbserial: USB Serial support registered for generic396gitlab # [ 0.581622] ehci-pci 0000:00:0a.0: EHCI Host Controller397gitlab # [ 0.581698] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1398gitlab # [ 0.582555] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000399gitlab # [ 0.583393] hv_vmbus: registering driver hyperv_keyboard400gitlab # [ 0.585601] rtc-pl031 9010000.pl031: registered as rtc0401gitlab # [ 0.585659] rtc-pl031 9010000.pl031: setting system clock to 2026-08-20T05:47:54 UTC (1787204874)402gitlab # [ 0.586552] i2c_dev: i2c /dev entries driver403gitlab # [ 0.594463] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00404gitlab # [ 0.594825] sdhci: Secure Digital Host Controller Interface driver405gitlab # [ 0.594841] sdhci: Copyright(c) Pierre Ossman406gitlab # [ 0.595454] hub 1-0:1.0: USB hub found407gitlab # [ 0.595482] hub 1-0:1.0: 6 ports detected408gitlab # [ 0.595721] Synopsys Designware Multimedia Card Interface Driver409gitlab # [ 0.596804] sdhci-pltfm: SDHCI platform and OF driver helper410gitlab # [ 0.601250] hid: raw HID events driver (C) Jiri Kosina411gitlab # [ 0.602026] usbcore: registered new interface driver usbhid412gitlab # [ 0.602036] usbhid: USB HID core driver413gitlab # [ 0.608351] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available414gitlab # [ 0.612815] drop_monitor: Initializing network drop monitor service415gitlab # [ 0.613182] NET: Registered PF_INET6 protocol family416gitlab # [ 0.615230] Segment Routing with IPv6417gitlab # [ 0.615309] In-situ OAM (IOAM) with IPv6418gitlab # [ 0.615394] NET: Registered PF_PACKET protocol family419gitlab # [ 0.615724] 9pnet: Installing 9P2000 support420gitlab # [ 0.619758] Key type dns_resolver registered421gitlab # [ 0.636969] registered taskstats version 1422gitlab # [ 0.637476] Loading compiled-in X.509 certificates423gitlab # [ 0.656748] Demotion targets for Node 0: null424gitlab # [ 0.656963] Key type .fscrypt registered425gitlab # [ 0.656969] Key type fscrypt-provisioning registered426gitlab # [ 0.657124] ima: No TPM chip found, activating TPM-bypass!427gitlab # [ 0.657146] ima: Allocated hash algorithm: sha1428gitlab # [ 0.657187] ima: No architecture policies found429gitlab # [ 0.658192] input: gpio-keys as /devices/platform/gpio-keys/input/input0430gitlab # [ 0.681146] clk: Disabling unused clocks431gitlab # [ 0.681173] PM: genpd: Disabling unused power domains432gitlab # [ 0.685972] Freeing unused kernel memory: 4736K433gitlab # [ 0.686227] Run /init as init process434gitlab # [ 0.717562] systemd[1]: Successfully made /usr/ read-only.435gitlab # [ 0.850411] usb 1-1: new high-speed USB device number 2 using ehci-pci436gitlab # [ 1.004912] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1437gitlab # [ 1.052105] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)438gitlab # [ 1.052175] systemd[1]: Detected virtualization qemu.439gitlab # [ 1.052251] systemd[1]: Detected architecture arm64.440gitlab # [ 1.052268] systemd[1]: Running in initrd.441gitlab # [ 1.053149] systemd[1]: Initializing machine ID from random generator.442gitlab # [ 1.053413] systemd[1]: Hostname set to <gitlab>.443gitlab # [ 1.127160] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0444gitlab # [ 1.246435] usb 1-2: new high-speed USB device number 3 using ehci-pci445gitlab # [ 1.296837] systemd[1]: bpf-restrict-fs: LSM BPF program attached446gitlab # [ 1.399091] systemd[1]: Queued start job for default target Initrd Default Target.447gitlab # [ 1.411431] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2448gitlab # [ 1.411884] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0449gitlab # [ 1.428256] systemd[1]: Created slice Slice /system/modprobe.450gitlab # [ 1.428754] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.451gitlab # [ 1.428823] systemd[1]: Expecting device /dev/disk/by-label/nix-store...452gitlab # [ 1.428849] systemd[1]: Expecting device /dev/disk/by-label/nixos...453gitlab # [ 1.428896] systemd[1]: Reached target Path Units.454gitlab # [ 1.428929] systemd[1]: Reached target Slice Units.455gitlab # [ 1.428964] systemd[1]: Reached target Swaps.456gitlab # [ 1.429002] systemd[1]: Reached target Timer Units.457gitlab # [ 1.429339] systemd[1]: Listening on D-Bus System Message Bus Socket.458gitlab # [ 1.429679] systemd[1]: Listening on Journal Socket (/dev/log).459gitlab # [ 1.430072] systemd[1]: Listening on Journal Sockets.460gitlab # [ 1.430478] systemd[1]: Listening on udev Control Socket.461gitlab # [ 1.430673] systemd[1]: Listening on udev Kernel Socket.462gitlab # [ 1.430716] systemd[1]: Reached target Socket Units.463gitlab # [ 1.434024] systemd[1]: Starting Create List of Static Device Nodes...464gitlab # [ 1.437541] systemd[1]: Starting Load Kernel Module 9pnet_virtio...465gitlab # [ 1.437686] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs466gitlab # [ 1.441224] systemd[1]: Mounting Kernel Configuration File System...467gitlab # [ 1.471493] systemd[1]: Starting Journal Service...468gitlab # [ 1.474195] systemd[1]: Starting Load Kernel Modules...469gitlab # [ 1.474388] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os470gitlab # [ 1.476681] systemd[1]: Starting Coldplug All udev Devices...471gitlab # [ 1.483928] systemd[1]: Finished Create List of Static Device Nodes.472gitlab # [ 1.485491] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.473gitlab # [ 1.488592] systemd[1]: Finished Load Kernel Module 9pnet_virtio.474gitlab # [ 1.489411] systemd[1]: Mounted Kernel Configuration File System.475gitlab # [ 1.498688] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...476gitlab # [ 1.528780] systemd-journald[95]: Collecting audit messages is disabled.477gitlab # [ 1.532858] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.478gitlab # [ 1.538674] systemd[1]: Starting Create Static Device Nodes in /dev...479gitlab # [ 1.545009] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.480gitlab # [ 1.545657] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0481gitlab # [ 1.545926] [drm] features: -virgl +edid -resource_blob -host_visible482gitlab # [ 1.545930] [drm] features: -context_init483gitlab # [ 1.550630] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev484gitlab # [ 1.550657] [drm] number of scanouts: 1485gitlab # [ 1.550683] [drm] number of cap sets: 0486gitlab # [ 1.552846] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic487gitlab # [ 1.552858] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0488gitlab # [ 1.560857] Console: switching to colour frame buffer device 160x50489gitlab # [ 1.571735] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device490gitlab # [ 1.575949] systemd[1]: Finished Create Static Device Nodes in /dev.491gitlab # [ 1.576388] systemd[1]: Reached target Preparation for Local File Systems.492gitlab # [ 1.577001] systemd[1]: Reached target Local File Systems.493gitlab # [ 1.583645] systemd[1]: Starting Rule-based Manager for Device Events and Files...494gitlab # [ 1.610755] systemd[1]: Finished Load Kernel Modules.495gitlab # [ 1.614562] systemd[1]: Starting Apply Kernel Variables...496gitlab # [ 1.626448] systemd[1]: Started Journal Service.497gitlab # [ 1.624563] systemd-modules-load[96]: Using 4 probe threads498gitlab # [ 1.630331] systemd-modules-load[96]: Module 'virtio_balloon' is built in499gitlab # [ 1.632489] systemd-modules-load[96]: Module 'virtio_console' is built in500gitlab # [ 1.633889] systemd-modules-load[96]: Module 'virtio_rng' is built in501gitlab # [ 1.636942] systemd-modules-load[96]: Inserted module 'dm_mod'502gitlab # [ 1.638100] systemd-modules-load[96]: Inserted module 'virtio_gpu'503gitlab # [ 1.639309] systemd[1]: Starting Create System Files and Directories...504gitlab # [ 1.640830] systemd[1]: Finished Apply Kernel Variables.505gitlab # [ 1.644957] systemd-udevd[106]: Using default interface naming scheme 'v261'.506gitlab # [ 1.651689] systemd[1]: Finished Create System Files and Directories.507gitlab # [ 1.663338] systemd[1]: Started Rule-based Manager for Device Events and Files.508gitlab # [ 1.684860] systemd[1]: Starting Virtual Console Setup...509gitlab # [ 1.755910] systemd-vconsole-setup[130]: Configuration of first virtual console was skipped, ignoring remaining ones.510gitlab # [ 1.761699] systemd[1]: Finished Virtual Console Setup.511gitlab # [ 2.167565] systemd[1]: Finished Coldplug All udev Devices.512gitlab # [ 2.171393] systemd[1]: Reached target System Initialization.513gitlab # [ 2.174031] systemd[1]: Reached target Basic System.514gitlab # [ 2.378970] (udev-worker)[123]: Network interface NamePolicy= disabled on kernel command line.515gitlab # [ 2.383295] (udev-worker)[146]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.516gitlab # [ 2.392367] (udev-worker)[146]: Network interface NamePolicy= disabled on kernel command line.517gitlab # [ 2.416085] systemd[1]: Found device /dev/disk/by-label/nixos.518gitlab # [ 2.419799] systemd[1]: Reached target Initrd Root Device.519gitlab # [ 2.421098] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...520gitlab # [ 2.430888] systemd[1]: Found device /dev/disk/by-label/nix-store.521gitlab # [ 2.459382] systemd-fsck[152]: nixos: clean, 12/65536 files, 13019/262144 blocks522gitlab # [ 2.463275] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.523gitlab # [ 2.477669] systemd[1]: Mounting /sysroot...524gitlab # [ 2.514816] EXT4-fs (vda): mounted filesystem 2e6bc365-09fa-4204-bc2f-7471b33647c4 r/w with ordered data mode. Quota mode: none.525gitlab # [ 2.514976] systemd[1]: Mounted /sysroot.526gitlab # [ 2.516181] systemd[1]: Reached target Initrd Root File System.527gitlab # [ 2.519699] systemd[1]: Mounting /sysroot/nix/.ro-store...528gitlab # [ 2.523615] systemd[1]: Mounting /sysroot/nix/.rw-store...529gitlab # [ 2.534494] systemd[1]: Mounting /sysroot/run...530gitlab # [ 2.541216] systemd[1]: Mounting /sysroot/tmp/shared...531gitlab # [ 2.548270] systemd[1]: Mounting /sysroot/tmp/xchg...532gitlab # [ 2.550995] systemd[1]: Starting Mountpoints Configured in the Real Root...533gitlab # [ 2.559346] systemd[1]: Mounted /sysroot/nix/.rw-store.534gitlab # [ 2.564920] systemd[1]: Mounted /sysroot/run.535gitlab # [ 2.570324] systemd-sysroot-fstab-check[166]: /sysroot should be mounted in the initrd, will request daemon-reload.536gitlab # [ 2.594546] systemd[1]: Starting rw-sysroot-nix-store.service...537gitlab # [ 2.596546] systemd[1]: Reload requested from client PID 166 ('systemd-sysroot') (unit initrd-parse-etc.service)...538gitlab # [ 2.599865] systemd[1]: Reloading...539gitlab # [ 2.851644] erofs (device vdb): mounted with root inode @ nid 128.540gitlab # [ 2.904060] systemd[1]: Reloading finished in 304 ms.541gitlab # [ 2.957575] systemd-sysroot-fstab-check[166]: Requesting initrd-fs.target/start/replace...542gitlab # [ 2.960794] systemd[1]: Mounted /sysroot/nix/.ro-store.543gitlab # [ 2.961615] systemd[1]: Mounted /sysroot/tmp/shared.544gitlab # [ 2.962526] systemd[1]: Mounted /sysroot/tmp/xchg.545gitlab # [ 2.964107] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.546gitlab # [ 2.965171] systemd[1]: Finished rw-sysroot-nix-store.service.547gitlab # [ 2.966094] systemd-sysroot-fstab-check[166]: Requesting swap.target/start/replace...548gitlab # [ 2.972515] systemd[1]: Starting rw-sysroot-nix-store.service...549gitlab # [ 2.973446] systemd[1]: initrd-parse-etc.service: Deactivated successfully.550gitlab # [ 2.975060] systemd[1]: Finished Mountpoints Configured in the Real Root.551gitlab # [ 2.976068] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.552gitlab # [ 2.991755] (udev-worker)[125]: mtd0ro: Failed to find and pin callout binary "/nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/mtd_probe": No such file or directory553gitlab # [ 2.999232] (udev-worker)[125]: mtd0ro: /nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory554gitlab # [ 3.002783] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.555gitlab # [ 3.003949] systemd[1]: Stopped Virtual Console Setup.556gitlab # [ 3.004815] systemd[1]: Stopping Virtual Console Setup...557gitlab # [ 3.005609] systemd[1]: Starting Virtual Console Setup...558gitlab # [ 3.006397] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.559gitlab # [ 3.007409] systemd[1]: Finished rw-sysroot-nix-store.service.560gitlab # [ 3.008281] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.561gitlab # [ 3.009324] systemd[1]: Stopped Virtual Console Setup.562gitlab # [ 3.010053] systemd[1]: Starting Virtual Console Setup...563gitlab # [ 3.028037] systemd-vconsole-setup[202]: Configuration of first virtual console was skipped, ignoring remaining ones.564gitlab # [ 3.029745] systemd[1]: Finished Virtual Console Setup.565gitlab # [ 3.483384] systemd[1]: Mounting /sysroot/nix/store...566gitlab # [ 3.555445] systemd[1]: Mounted /sysroot/nix/store.567gitlab # [ 3.557869] systemd[1]: Reached target Initrd File Systems.568gitlab # [ 3.560387] systemd[1]: Starting Find NixOS closure...569gitlab # [ 3.562648] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...570gitlab # [ 3.605365] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.571gitlab # [ 3.609085] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.572gitlab # [ 3.625407] systemd[1]: Finished Find NixOS closure.573gitlab # [ 3.627683] systemd[1]: Reached target Initrd Default Target.574gitlab # [ 3.630295] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...575gitlab # [ 3.691674] systemd[1]: Stopped target Initrd Default Target.576gitlab # [ 3.694479] systemd[1]: Stopped target Basic System.577gitlab # [ 3.696934] systemd[1]: Stopped target Initrd Root Device.578gitlab # [ 3.699276] systemd[1]: Stopped target Path Units.579gitlab # [ 3.701532] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.580gitlab # [ 3.704772] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.581gitlab # [ 3.707994] systemd[1]: Stopped target Slice Units.582gitlab # [ 3.710204] systemd[1]: Stopped target Socket Units.583gitlab # [ 3.714045] systemd[1]: Stopped target System Initialization.584gitlab # [ 3.717575] systemd[1]: Stopped target Swaps.585gitlab # [ 3.722428] systemd[1]: Stopped target Timer Units.586gitlab # [ 3.727168] systemd[1]: dbus.socket: Deactivated successfully.587gitlab # [ 3.731736] systemd[1]: Closed D-Bus System Message Bus Socket.588gitlab # [ 3.734872] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.589gitlab # [ 3.737896] systemd[1]: Stopped Find NixOS closure.590gitlab # [ 3.739787] systemd[1]: Starting Load Kernel Module 9pnet_virtio...591gitlab # [ 3.742234] systemd[1]: Starting rw-sysroot-nix-store.service...592gitlab # [ 3.744365] systemd[1]: systemd-sysctl.service: Deactivated successfully.593gitlab # [ 3.746442] systemd[1]: Stopped Apply Kernel Variables.594gitlab # [ 3.748161] systemd[1]: systemd-modules-load.service: Deactivated successfully.595gitlab # [ 3.750236] systemd[1]: Stopped Load Kernel Modules.596gitlab # [ 3.751679] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.597gitlab # [ 3.754021] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.598gitlab # [ 3.756094] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.599gitlab # [ 3.757986] systemd[1]: Stopped Create System Files and Directories.600gitlab # [ 3.759628] systemd[1]: Stopped target Local File Systems.601gitlab # [ 3.761164] systemd[1]: Stopped target Preparation for Local File Systems.602gitlab # [ 3.762846] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.603gitlab # [ 3.764602] systemd[1]: Stopped Coldplug All udev Devices.604gitlab # [ 3.765881] systemd[1]: Stopping Rule-based Manager for Device Events and Files...605gitlab # [ 3.767537] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.606gitlab # [ 3.769281] systemd[1]: Stopped Virtual Console Setup.607gitlab # [ 3.770406] systemd[1]: initrd-cleanup.service: Deactivated successfully.608gitlab # [ 3.771848] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.609gitlab # [ 3.773348] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.610gitlab # [ 3.774815] systemd[1]: Finished Load Kernel Module 9pnet_virtio.611gitlab # [ 3.776084] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.612gitlab # [ 3.777491] systemd[1]: Finished rw-sysroot-nix-store.service.613gitlab # [ 3.778612] systemd[1]: systemd-udevd.service: Deactivated successfully.614gitlab # [ 3.779874] systemd[1]: Stopped Rule-based Manager for Device Events and Files.615gitlab # [ 3.781347] systemd[1]: systemd-udevd.service: Consumed 2.293s CPU time over 2.180s wall clock time, 31.8M memory peak.616gitlab # [ 3.783366] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.617gitlab # [ 3.784754] systemd[1]: Closed udev Control Socket.618gitlab # [ 3.785683] systemd[1]: Starting Cleanup udev Database...619gitlab # [ 3.786709] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.620gitlab # [ 3.788158] systemd[1]: Stopped Create Static Device Nodes in /dev.621gitlab # [ 3.789334] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.622gitlab # [ 3.790861] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.623gitlab # [ 3.792364] systemd[1]: kmod-static-nodes.service: Deactivated successfully.624gitlab # [ 3.793678] systemd[1]: Stopped Create List of Static Device Nodes.625gitlab # [ 3.875894] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.626gitlab # [ 3.879192] systemd[1]: Finished Cleanup udev Database.627gitlab # [ 3.881591] systemd[1]: Reached target Switch Root.628gitlab # [ 3.883712] systemd[1]: Starting NixOS Activation...629gitlab # [ 4.063599] initrd-nixos-activation-start[227]: booting system configuration /nix/store/yxp8b3cl0ya2z54s70kcr7qszy6xwy14-nixos-system-gitlab-test630gitlab # [ 4.125549] initrd-nixos-activation-start[227]: running activation script...631gitlab # [ 4.456112] initrd-nixos-activation-start[250]: setting up /etc...632gitlab # [ 4.632551] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.633gitlab # [ 4.635877] systemd[1]: Finished NixOS Activation.634gitlab # [ 4.638257] systemd[1]: Starting Switch Root...635gitlab # [ 4.687001] systemd[1]: Switching root.636gitlab # [ 4.795072] systemd-journald[95]: Received SIGTERM from PID 1 (systemd).637gitlab # [ 5.427475] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)638gitlab # [ 5.427612] systemd[1]: Detected virtualization qemu.639gitlab # [ 5.427688] systemd[1]: Detected architecture arm64.640gitlab # [ 5.427867] systemd[1]: Detected first boot.641gitlab # [ 5.429300] systemd[1]: Initializing machine ID from random generator.642gitlab # [ 5.676899] systemd[1]: bpf-restrict-fs: LSM BPF program attached643gitlab # [ 5.792939] systemd[1]: Applying preset policy.644gitlab # [ 5.992354] systemd[1]: Populated /etc with preset unit settings.645gitlab # [ 6.154287] systemd[1]: initrd-switch-root.service: Deactivated successfully.646gitlab # [ 6.154774] systemd[1]: Stopped initrd-switch-root.service.647gitlab # [ 6.157413] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.648gitlab # [ 6.162057] systemd[1]: Created slice Slice /system/getty.649gitlab # [ 6.169325] systemd[1]: Created slice GitLab DevOps Platform Slice.650gitlab # [ 6.173307] systemd[1]: Created slice User and Session Slice.651gitlab # [ 6.173923] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.652gitlab # [ 6.175139] systemd[1]: Started Forward Password Requests to Wall Directory Watch.653gitlab # [ 6.176177] systemd[1]: Expecting device /dev/hvc0...654gitlab # [ 6.176890] systemd[1]: Expecting device /dev/ttyAMA0...655gitlab # [ 6.177587] systemd[1]: Reached target Local Encrypted Volumes.656gitlab # [ 6.178313] systemd[1]: Stopped target initrd-fs.target.657gitlab # [ 6.179316] systemd[1]: Stopped target initrd-root-fs.target.658gitlab # [ 6.180364] systemd[1]: Stopped target initrd-switch-root.target.659gitlab # [ 6.181443] systemd[1]: Reached target Virtual Machines and Containers.660gitlab # [ 6.182537] systemd[1]: Reached target Path Units.661gitlab # [ 6.183616] systemd[1]: Reached target Remote File Systems.662gitlab # [ 6.184687] systemd[1]: Reached target Slice Units.663gitlab # [ 6.185743] systemd[1]: Reached target Swaps.664gitlab # [ 6.189829] systemd[1]: Listening on Query the User Interactively for a Password.665gitlab # [ 6.194101] systemd[1]: Listening on Process Core Dump Socket.666gitlab # [ 6.197057] systemd[1]: Listening on Credential Encryption/Decryption.667gitlab # [ 6.200485] systemd[1]: Listening on Factory Reset Management.668gitlab # [ 6.201724] systemd[1]: Listening on Hostname Service Socket.669gitlab # [ 6.211105] systemd[1]: Starting Journal Log Access Socket...670gitlab # [ 6.213257] systemd[1]: Listening on Journal Audit Socket.671gitlab # [ 6.217417] systemd[1]: Listening on Console Output Muting Service Socket.672gitlab # [ 6.219165] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.673gitlab # [ 6.220358] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os674gitlab # [ 6.221435] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki675gitlab # [ 6.228015] systemd[1]: Listening on Disk Repartitioning Service Socket.676gitlab # [ 6.229448] systemd[1]: Listening on udev Control Socket.677gitlab # [ 6.230929] systemd[1]: Listening on udev Varlink Socket.678gitlab # [ 6.271113] systemd[1]: Mounting Huge Pages File System...679gitlab # [ 6.276550] systemd[1]: Mounting POSIX Message Queue File System...680gitlab # [ 6.282792] systemd[1]: Mounting Kernel Debug File System...681gitlab # [ 6.303433] systemd[1]: Mounting Kernel Trace File System...682gitlab # [ 6.311171] systemd[1]: Starting Create List of Static Device Nodes...683gitlab # [ 6.317744] systemd[1]: Starting Load Kernel Module 9pnet_virtio...684gitlab # [ 6.318936] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs685gitlab # [ 6.329206] systemd[1]: Mounting Kernel Configuration File System...686gitlab # [ 6.330380] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm687gitlab # [ 6.331512] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore688gitlab # [ 6.344248] systemd[1]: Starting Load Kernel Module fuse...689gitlab # [ 6.350187] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67690gitlab # [ 6.366856] systemd[1]: Starting Journal Service...691gitlab # [ 6.372347] systemd[1]: Starting Load Kernel Modules...692gitlab # [ 6.382738] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...693gitlab # [ 6.397710] systemd[1]: Starting Remount Root and Kernel File Systems...694gitlab # [ 6.398609] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os695gitlab # [ 6.405000] fuse: init (API version 7.45)696gitlab # [ 6.409908] systemd[1]: Starting Coldplug All udev Devices...697gitlab # [ 6.417176] systemd[1]: Listening on Journal Log Access Socket.698gitlab # [ 6.417995] systemd[1]: Mounted Huge Pages File System.699gitlab # [ 6.418716] systemd[1]: Mounted POSIX Message Queue File System.700gitlab # [ 6.419675] systemd[1]: Mounted Kernel Debug File System.701gitlab # [ 6.420451] systemd[1]: Mounted Kernel Trace File System.702gitlab # [ 6.421548] systemd[1]: Finished Create List of Static Device Nodes.703gitlab # [ 6.422503] systemd-journald[321]: Collecting audit messages is enabled.704gitlab # [ 6.423343] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.705gitlab # [ 6.426546] systemd[1]: Finished Load Kernel Module 9pnet_virtio.706gitlab # [ 6.430932] systemd[1]: Mounted Kernel Configuration File System.707gitlab # [ 6.431791] systemd[1]: modprobe@fuse.service: Deactivated successfully.708gitlab # [ 6.432715] systemd[1]: Finished Load Kernel Module fuse.709gitlab # [ 6.433871] systemd[1]: Finished Load Kernel Modules.710gitlab # [ 6.446971] systemd[1]: Mounting FUSE Control File System...711gitlab # [ 6.444933] systemd[1]: Queued start job for default target Multi-User System.712gitlab # [ 6.448191] systemd[1]: Unnecessary job was removed for /dev/vdb.713gitlab # [ 6.452957] EXT4-fs (vda): re-mounted 2e6bc365-09fa-4204-bc2f-7471b33647c4.714gitlab # [ 6.450691] systemd[1]: systemd-journald.service: Deactivated successfully.715gitlab # [ 6.455351] systemd-modules-load[322]: Using 3 probe threads716gitlab # [ 6.457037] systemd-modules-load[322]: Module 'atkbd' is built in717gitlab # [ 6.458593] systemd-modules-load[322]: Module 'loop' is built in718gitlab # [ 6.460133] systemd-modules-load[322]: Inserted module 'tls'[ 6.462581] systemd[1]: Starting Firewall...719gitlab # 720gitlab # [ 6.466475] systemd[1]: Starting Apply Kernel Variables...721gitlab # [ 6.470719] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...722gitlab # [ 6.473000] systemd[1]: Started Journal Service.723gitlab # [ 6.481263] systemd[1]: Finished Remount Root and Kernel File Systems.724gitlab # [ 6.484902] systemd[1]: Mounted FUSE Control File System.725gitlab # [ 6.491194] systemd-oomd[323]: No swap; memory pressure usage will be degraded726gitlab # [ 6.496254] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.727gitlab # [ 6.499900] systemd[1]: Listening on Disk Image Download Service Socket.728gitlab # [ 6.507191] systemd[1]: Starting Flush Journal to Persistent Storage...729gitlab # [ 6.509148] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore730gitlab # [ 6.521966] systemd[1]: Starting Load/Save OS Random Seed...731gitlab # [ 6.523083] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os732gitlab # [ 6.529691] systemd-journald[321]: Received client request to flush runtime journal.733gitlab # [ 6.558333] systemd[1]: Finished Apply Kernel Variables.734gitlab # [ 6.559897] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.735gitlab # [ 6.561457] systemd[1]: Starting Create Static Device Nodes in /dev...736gitlab # [ 6.562576] systemd[1]: Finished Load/Save OS Random Seed.737gitlab # [ 6.563985] systemd[1]: Reached target First Boot Complete.738gitlab # [ 6.564941] systemd[1]: Finished Flush Journal to Persistent Storage.739gitlab # [ 6.565870] systemd[1]: Finished Create Static Device Nodes in /dev.740gitlab # [ 6.566798] systemd[1]: Reached target Preparation for Local File Systems.741gitlab # [ 6.568490] systemd[1]: Starting Rule-based Manager for Device Events and Files...742gitlab # [ 6.633980] systemd-udevd[375]: Using default interface naming scheme 'v261'.743gitlab # [ 6.663957] systemd[1]: Started Rule-based Manager for Device Events and Files.744gitlab # [ 6.835699] systemd[1]: Finished Firewall.745gitlab # [ 7.126824] systemd[1]: Finished Coldplug All udev Devices.746gitlab # [ 7.158441] systemd[1]: Mounting /run/wrappers...747gitlab # [ 7.183292] systemd[1]: Mounted /run/wrappers.748gitlab # [ 7.185611] systemd[1]: Reached target Local File Systems.749gitlab # [ 7.188097] systemd[1]: Listening on Boot Loader Control Service Socket.750gitlab # [ 7.192690] systemd[1]: Starting register-nix-paths.service...751gitlab # [ 7.197172] systemd[1]: Starting Create SUID/SGID Wrappers...752gitlab # [ 7.200196] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.753gitlab # [ 7.228122] systemd[1]: Starting Save Transient machine-id to Disk...754gitlab # [ 7.232445] systemd[1]: Starting Create System Files and Directories...755gitlab # [ 7.236222] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs756gitlab # [ 7.314761] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.757gitlab # [ 7.318003] systemd[1]: Finished Save Transient machine-id to Disk.758gitlab # [ 7.321258] systemd[1]: Finished Create System Files and Directories.759gitlab # [ 7.325079] systemd[1]: Starting Rebuild Journal Catalog...760gitlab # [ 7.328848] systemd[1]: Starting Record System Boot/Shutdown in UTMP...761gitlab # [ 7.358676] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.762gitlab # [ 7.369282] systemd[1]: Finished Record System Boot/Shutdown in UTMP.763gitlab # [ 7.387311] (udev-worker)[415]: Network interface NamePolicy= disabled on kernel command line.764gitlab # [ 7.404752] systemd[1]: Finished Rebuild Journal Catalog.765gitlab # [ 7.408399] systemd[1]: Starting Update is Completed...766gitlab # [ 7.411594] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped.767gitlab # [ 7.415096] (udev-worker)[426]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.768gitlab # [ 7.417760] (udev-worker)[426]: Network interface NamePolicy= disabled on kernel command line.769gitlab # [ 7.423613] systemd[1]: Condition check resulted in Virtio network device being skipped.770gitlab # [ 7.426001] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore771gitlab # [ 7.428221] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.772gitlab # [ 7.430304] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67773gitlab # [ 7.433155] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore774gitlab # [ 7.435376] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os775gitlab # [ 7.437160] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os776gitlab # [ 7.438592] systemd[1]: Finished Update is Completed.777gitlab # [ 7.473973] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.778gitlab # [ 7.475256] systemd[1]: Finished Create SUID/SGID Wrappers.779gitlab # [ 7.476251] systemd[1]: suid-sgid-wrappers.service: Consumed 165ms CPU time over 276ms wall clock time, 5.7M memory peak, 1.9M read from disk.780gitlab # [ 7.531950] mousedev: PS/2 mouse device common for all mice781gitlab # [ 7.722901] systemd[1]: Finished register-nix-paths.service.782gitlab # [ 7.724648] systemd[1]: Reached target System Initialization.783gitlab # [ 7.725562] systemd[1]: Started Discard unused filesystem blocks once a week.784gitlab # [ 7.726575] systemd[1]: Started logrotate.timer.785gitlab # [ 7.727311] systemd[1]: Started Daily Cleanup of Temporary Directories.786gitlab # [ 7.728519] systemd[1]: Reached target Timer Units.787gitlab # [ 7.730360] systemd[1]: Listening on D-Bus System Message Bus Socket.788gitlab # [ 7.731886] systemd[1]: Listening on Nix Daemon Socket.789gitlab # [ 7.738597] systemd[1]: Starting nixbot CI service socket...790gitlab # [ 7.739946] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.791gitlab # [ 7.742594] systemd[1]: Listening on nixbot CI service socket.792gitlab # [ 7.743438] systemd[1]: Reached target Socket Units.793gitlab # [ 7.746031] systemd[1]: Starting D-Bus System Message Bus...794gitlab # [ 7.783352] dbus-broker-launch[566]: Looking up NSS user entry for 'systemd-timesync'...795gitlab # [ 7.785197] dbus-broker-launch[566]: NSS returned no entry for 'systemd-timesync'796gitlab # [ 7.788555] dbus-broker-launch[566]: Invalid user-name in /nix/store/9zcyylhndlnizbwn48627991zr1jxg4p-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"797gitlab # [ 7.791290] systemd[1]: Started D-Bus System Message Bus.798gitlab # [ 7.798272] dbus-broker-launch[566]: Ready799gitlab # [ 7.799315] systemd[1]: Reached target Basic System.800gitlab # [ 7.801312] systemd[1]: Started backdoor.service.801gitlab # [ 7.804928] systemd[1]: Starting gitlab-config.service...802gitlab # [ 7.828279] systemd[1]: Starting Import lastlog data into lastlog2 database...803gitlab # [ 7.829975] systemd[1]: Starting Logrotate configuration check...804gitlab # connecting to host...805gitlab # [ 7.844527] systemd[1]: Starting Name Service Cache Daemon (nsncd)...806gitlab # [ 7.845855] logrotate[571]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.807gitlab: Guest shell says: b'Spawning backdoor root shell...\n'808gitlab # [ 7.851401] logrotate[571]: reading config file /nix/store/22afkmbkaxyx50bj9lbkkpmz7pd69hsf-logrotate.conf809gitlab # [ 7.854295] logrotate[571]: note: 'monthly' overrides previously specified 'weekly'810gitlab # [ 7.855246] logrotate[571]: Reading state from file: /var/lib/logrotate.status811gitlab: connected to guest root shell812gitlab # [ 7.856232] logrotate[571]: state file /var/lib/logrotate.status does not exist813gitlab: (connecting took 8.31 seconds)814gitlab # [ 7.857136] logrotate[571]: Allocating hash table for state file, size 64 entries815gitlab: (finished: waiting for the VM to finish booting, in 8.31 seconds)816gitlab # [ 7.858032] logrotate[571]: Handling 4 logs817gitlab # [ 7.858567] logrotate[571]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed818gitlab # [ 7.863689] logrotate[571]: considering log /var/log/btmp819gitlab # [ 7.864511] logrotate[571]: Creating new state820gitlab # [ 7.865106] logrotate[571]: Now: 2026-08-20 05:48821gitlab # [ 7.865721] logrotate[571]: Last rotated at 2026-08-20 05:00822gitlab # [ 7.866421] logrotate[571]: log does not need rotating (log has already been rotated)823gitlab # [ 7.867376] logrotate[571]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed824gitlab # [ 7.872237] logrotate[571]: considering log /var/log/wtmp825gitlab # [ 7.873069] logrotate[571]: Creating new state826gitlab # [ 7.873820] logrotate[571]: Now: 2026-08-20 05:48827gitlab # [ 7.874487] logrotate[571]: Last rotated at 2026-08-20 05:00828gitlab # [ 7.875289] logrotate[571]: log does not need rotating (log has already been rotated)829gitlab # [ 7.883590] logrotate[571]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed830gitlab # [ 7.886044] logrotate[571]: switching euid from 0 to 165 and egid from 0 to 165 (pid 571)831gitlab # [ 7.887113] logrotate[571]: considering log /var/gitlab/state/log/*.log832gitlab # [ 7.887978] logrotate[571]: log /var/gitlab/state/log/*.log does not exist -- skipping833gitlab # [ 7.892224] logrotate[571]: Creating new state834gitlab # [ 7.892901] logrotate[571]: switching euid from 165 to 0 and egid from 165 to 0 (pid 571)835gitlab # [ 7.893981] logrotate[571]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed836gitlab # [ 7.895801] logrotate[571]: switching euid from 0 to 60 and egid from 0 to 60 (pid 571)837gitlab # [ 7.900176] logrotate[571]: considering log /var/log/nginx/*.log838gitlab # [ 7.903544] logrotate[571]: log /var/log/nginx/*.log does not exist -- skipping839gitlab # [ 7.904776] logrotate[571]: Creating new state840gitlab # [ 7.905398] logrotate[571]: not running postrotate script, since no logs were rotated841gitlab # [ 7.906440] logrotate[571]: switching euid from 60 to 0 and egid from 60 to 0 (pid 571)842gitlab # [ 7.908090] systemd[1]: Starting Post-Boot Actions...843gitlab # [ 7.910703] systemd[1]: Started Reset console on configuration changes.844gitlab # [ 7.912149] systemd[1]: Starting resolvconf update...845gitlab # [ 7.914838] nsncd[575]: Aug 20 05:48:01.803 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"846gitlab # [ 7.919423] systemd[1]: Finished Logrotate configuration check.847gitlab # [ 7.920667] systemd[1]: Finished Post-Boot Actions.848gitlab # [ 7.921543] systemd[1]: Started Name Service Cache Daemon (nsncd).849gitlab # [ 7.923024] systemd[1]: Reached target Host and Network Name Lookups.850gitlab # [ 7.924099] systemd[1]: Reached target User and Group Name Lookups.851gitlab # [ 7.925121] systemd[1]: Starting User Login Management...852gitlab # [ 7.929842] systemd[1]: Finished Import lastlog data into lastlog2 database.853gitlab # [ 7.979510] systemd-logind[606]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)854gitlab # [ 7.983495] systemd-logind[606]: Watching system buttons on /dev/input/event0 (gpio-keys)855gitlab # [ 7.986674] systemd-logind[606]: New seat seat0.856gitlab # [ 7.987493] systemd[1]: Stopped target Host and Network Name Lookups.857gitlab # [ 7.988694] systemd[1]: Stopping Host and Network Name Lookups...858gitlab # [ 7.990341] systemd[1]: Stopped target User and Group Name Lookups.859gitlab # [ 7.991277] systemd[1]: Stopping User and Group Name Lookups...860gitlab # [ 7.992242] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...861gitlab # [ 7.993792] systemd[1]: nscd.service: Deactivated successfully.862gitlab # [ 7.996655] systemd[1]: Stopped Name Service Cache Daemon (nsncd).863gitlab # [ 7.997610] systemd[1]: nscd.service: Consumed 21ms CPU time over 144ms wall clock time, 7.4M memory peak, 5.8M read from disk.864gitlab # [ 7.999117] systemd[1]: Started User Login Management.865gitlab # [ 8.005511] systemd[1]: Starting linger-users.service...866gitlab # [ 8.008386] systemd[1]: Starting Name Service Cache Daemon (nsncd)...867gitlab # [ 8.025706] systemd[1]: Finished resolvconf update.868gitlab # [ 8.027369] systemd[1]: Reached target Preparation for Network.869gitlab # [ 8.038112] systemd[1]: Starting DHCP Client...870gitlab # [ 8.047474] systemd[1]: Starting Address configuration of eth1...871gitlab # [ 8.052484] systemd[1]: Starting Extra networking commands....872gitlab # [ 8.053385] systemd[1]: linger-users.service: Deactivated successfully.873gitlab # [ 8.055746] nsncd[667]: Aug 20 05:48:01.970 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"874gitlab # [ 8.065130] systemd[1]: Finished linger-users.service.875gitlab # [ 8.069188] systemd[1]: Started Name Service Cache Daemon (nsncd).876gitlab # [ 8.070092] systemd[1]: Reached target Host and Network Name Lookups.877gitlab # [ 8.071133] systemd[1]: Reached target User and Group Name Lookups.878gitlab # [ 8.105191] network-addresses-eth1-start[680]: adding address 192.168.1.1/24... done879gitlab # [ 8.113078] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3880gitlab # [ 8.125673] network-addresses-eth1-start[680]: adding address 2001:db8:1::1/64... done881gitlab # [ 8.136985] systemd[1]: Finished Address configuration of eth1.882gitlab # [ 8.165651] dhcpcd[697]: dhcpcd-10.3.2 starting883gitlab # [ 8.169823] dhcpcd[729]: dev: loaded udev884gitlab # [ 8.183596] 8021q: 802.1Q VLAN Support v1.8885gitlab # [ 8.183950] 8021q: adding VLAN 0 to HW filter on device eth1886gitlab # [ 8.211542] systemd[1]: Finished Extra networking commands..887gitlab # [ 8.213841] systemd[1]: Reached target Network.888gitlab # [ 8.219758] systemd[1]: Starting gitlab-workhorse.service...889gitlab # [ 8.224931] systemd[1]: Starting Nginx Web Server...890gitlab # [ 8.229010] cfg80211: Loading compiled-in X.509 certificates for regulatory database891gitlab # [ 8.250837] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'892gitlab # [ 8.251336] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'893gitlab # [ 8.252843] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2894gitlab # [ 8.253142] cfg80211: failed to load regulatory.db895gitlab # [ 8.250203] systemd[1]: Starting PostgreSQL Server...896gitlab # [ 8.265902] systemd[1]: Starting Redis Server - redis-gitlab...897gitlab # [ 8.280205] systemd[1]: Starting Permit User Sessions...898gitlab # [ 8.285730] 8021q: adding VLAN 0 to HW filter on device eth0899gitlab # [ 8.284651] dhcpcd[729]: eth0: waiting for carrier900gitlab # [ 8.286137] dhcpcd[729]: eth0: carrier acquired901gitlab # [ 8.288554] dhcpcd[729]: DUID 00:01:00:01:32:19:51:92:52:54:00:12:34:56902gitlab # [ 8.289569] dhcpcd[729]: eth0: IAID 00:12:34:56903gitlab # [ 8.290211] dhcpcd[729]: eth0: adding address fe80::5054:ff:fe12:3456904gitlab # [ 8.301957] systemd[1]: Finished Permit User Sessions.905gitlab # [ 8.310158] systemd-logind[606]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)906gitlab # [ 8.316228] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.907gitlab # [ 8.321236] systemd[1]: Started Getty on tty1.908gitlab # [ 8.322049] systemd[1]: Reached target Login Prompts.909gitlab # [ 8.328509] systemd[1]: Starting Virtual Console Setup...910gitlab # [ 8.388801] systemd-vconsole-setup[789]: Configuration of first virtual console was skipped, ignoring remaining ones.911gitlab # [ 8.393349] systemd[1]: Finished Virtual Console Setup.912gitlab # [ 8.429678] nginx-pre-start[797]: nginx: the configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf syntax is ok913gitlab # [ 8.431427] nginx-pre-start[797]: nginx: configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf test is successful914gitlab # [ 8.440702] systemd[1]: Started Nginx Web Server.915gitlab # [ 8.475600] redis-server[795]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.916gitlab # [ 8.478346] redis-server[795]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo917gitlab # [ 8.480224] systemd[1]: Started Redis Server - redis-gitlab.918gitlab # [ 8.481967] postgresql-pre-start[799]: The files belonging to this database system will be owned by user "postgres".919gitlab # [ 8.483536] postgresql-pre-start[799]: This user must also own the server process.920gitlab # [ 8.484842] redis-server[795]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=795, just started921gitlab # [ 8.486455] postgresql-pre-start[799]: The database cluster will be initialized with locale "en_US.UTF-8".922gitlab # [ 8.487796] postgresql-pre-start[799]: The default database encoding has accordingly been set to "UTF8".923gitlab # [ 8.489200] postgresql-pre-start[799]: The default text search configuration will be set to "english".924gitlab # [ 8.490689] postgresql-pre-start[799]: Data page checksums are enabled.925gitlab # [ 8.492364] postgresql-pre-start[799]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok926gitlab # [ 8.493845] postgresql-pre-start[799]: creating subdirectories ... ok927gitlab # [ 8.494976] postgresql-pre-start[799]: selecting dynamic shared memory implementation ... posix928gitlab # [ 8.496262] redis-server[795]: Configuration loaded929gitlab # [ 8.497159] redis[795]: monotonic clock: ARM CNTVCT @ 1000 ticks/us930gitlab # [ 8.498310] redis[795]: Running mode=standalone, port=0.931gitlab # [ 8.499247] redis[795]: Server initialized932gitlab # [ 8.500048] redis[795]: Ready to accept connections unix933gitlab # [ 8.501076] redis[795]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.934gitlab # [ 8.527312] postgresql-pre-start[799]: selecting default "max_connections" ... 100935gitlab # [ 8.575784] postgresql-pre-start[799]: selecting default "shared_buffers" ... 128MB936gitlab # [ 8.884348] systemd[1]: Started gitlab-workhorse.service.937gitlab # [ 9.050910] postgresql-pre-start[799]: selecting default time zone ... UTC938gitlab # [ 9.052893] postgresql-pre-start[799]: creating configuration files ... ok939gitlab # [ 9.137033] gitlab-workhorse[823]: time="2026-08-20T05:48:03Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4940gitlab # [ 9.141289] gitlab-workhorse[823]: time="2026-08-20T05:48:03Z" level=info msg="Using redis/go-redis"941gitlab # [ 9.148735] gitlab-workhorse[823]: time="2026-08-20T05:48:03Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix942gitlab # [ 9.291578] postgresql-pre-start[799]: running bootstrap script ... ok943gitlab # [ 9.989942] postgresql-pre-start[799]: performing post-bootstrap initialization ... ok944gitlab # [ 10.229755] dhcpcd[729]: eth0: soliciting a DHCP lease945gitlab # [ 10.242445] postgresql-pre-start[799]: syncing data to disk ... ok946gitlab # [ 10.244106] postgresql-pre-start[799]: initdb: warning: enabling "trust" authentication for local connections947gitlab # [ 10.246548] postgresql-pre-start[799]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.948gitlab # [ 10.250623] postgresql-pre-start[799]: Success. You can now start the database server using:949gitlab # [ 10.253004] postgresql-pre-start[799]: pg_ctl -D /var/lib/postgresql/18 -l logfile start950gitlab # [ 10.255323] dhcpcd[729]: eth0: offered 10.0.2.15 from 10.0.2.2951gitlab # [ 10.264524] dhcpcd[729]: eth0: probing address 10.0.2.15/24952gitlab # [ 10.409222] postgres[857]: [857] LOG: starting PostgreSQL 18.4 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit953gitlab # [ 10.414911] postgres[857]: [857] LOG: listening on IPv6 address "::1", port 5432954gitlab # [ 10.418452] postgres[857]: [857] LOG: listening on IPv4 address "127.0.0.1", port 5432955gitlab # [ 10.421914] postgres[857]: [857] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"956gitlab # [ 10.430267] postgres[866]: [866] LOG: database system was shut down at 2026-08-20 05:48:03 GMT957gitlab # [ 10.441173] postgres[857]: [857] LOG: database system is ready to accept connections958gitlab # [ 10.446886] systemd[1]: Started PostgreSQL Server.959gitlab # [ 10.452177] systemd[1]: Starting PostgreSQL Setup Scripts...960gitlab # [ 10.511637] dhcpcd[729]: eth0: soliciting an IPv6 router961gitlab # [ 10.514447] dhcpcd[729]: eth0: Router Advertisement from fe80::2962gitlab # [ 10.517241] dhcpcd[729]: eth0: adding address fec0::5054:ff:fe12:3456/64963gitlab # [ 10.519991] dhcpcd[729]: eth0: adding route to fec0::/64964gitlab # [ 10.522493] dhcpcd[729]: eth0: adding default route via fe80::2965gitlab # [ 10.817093] postgresql-setup-start[877]: CREATE DATABASE966gitlab # [ 10.867348] postgresql-setup-start[887]: CREATE ROLE967gitlab # [ 10.892284] postgresql-setup-start[889]: ALTER DATABASE968gitlab # [ 10.951472] postgresql-setup-start[894]: CREATE ROLE969gitlab # [ 10.956798] systemd[1]: Finished PostgreSQL Setup Scripts.970gitlab # [ 10.959328] systemd[1]: Reached target PostgreSQL.971gitlab # [ 10.964322] systemd[1]: Starting gitlab-postgresql.service...972gitlab # [ 11.047229] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[882]: mkdir -p /var/gitlab/state/home/.ssh: OK973gitlab # [ 11.052611] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[882]: chmod 700 /var/gitlab/state/home/.ssh: OK974gitlab # [ 11.162434] systemd[1]: Finished gitlab-config.service.975gitlab # [ 11.172770] systemd[1]: Started gitaly.service.976gitlab # [ 11.176851] gitlab-postgresql-start[904]: CREATE DATABASE977gitlab # [ 11.178646] systemd[1]: Starting gitlab-db-config.service...978gitlab # [ 11.252833] gitlab-postgresql-start[930]: CREATE EXTENSION979gitlab # [ 11.357795] gitlab-postgresql-start[933]: CREATE EXTENSION980gitlab # [ 11.362484] systemd[1]: Finished gitlab-postgresql.service.981gitlab # [ 11.838110] gitaly[925]: time="2026-08-20T05:48:05.754Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/0r0qd84zrxhqq373hk9spv8j9pg0qlnq-gitaly.toml' and fix the errors that are printed." pid=925982gitlab # [ 11.842148] gitaly[925]: time="2026-08-20T05:48:05.754Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=925983gitlab # [ 11.843781] gitaly[925]: time="2026-08-20T05:48:05.754Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=925984gitlab # [ 11.848187] gitaly[925]: time="2026-08-20T05:48:05.755Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=925985gitlab # [ 11.849965] gitaly[925]: time="2026-08-20T05:48:05.755Z" level=info msg="Starting Gitaly" pid=925 version=986gitlab # [ 12.093109] gitaly[925]: time="2026-08-20T05:48:06.009Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=253 pid=925987gitlab # [ 12.096053] gitaly[925]: time="2026-08-20T05:48:06.009Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=925988gitlab # [ 12.098764] gitaly[925]: time="2026-08-20T05:48:06.011Z" level=info msg="finished initializing command factory" duration_ms=1 pid=925989gitlab # [ 12.101012] gitaly[925]: time="2026-08-20T05:48:06.011Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-925/git-exec-2216235139.d/git pid=925990gitlab # [ 12.108436] gitaly[925]: time="2026-08-20T05:48:06.025Z" level=info msg="finished detecting git version" duration_ms=13 pid=925991gitlab # [ 12.110574] gitaly[925]: time="2026-08-20T05:48:06.025Z" level=info msg="using Git version" pid=925 version=2.53.g992gitlab # [ 12.112501] gitaly[925]: time="2026-08-20T05:48:06.025Z" level=info msg="clearing disk cache object folder" pid=925 storage=default993gitlab # [ 12.114527] gitaly[925]: time="2026-08-20T05:48:06.026Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1101696386 pid=925 storage=default994gitlab # [ 12.118018] gitaly[925]: time="2026-08-20T05:48:06.026Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1101696386 pid=925 storage=default995gitlab # [ 12.121918] gitaly[925]: time="2026-08-20T05:48:06.026Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=925996gitlab # [ 12.125472] gitaly[925]: time="2026-08-20T05:48:06.026Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=925997gitlab # [ 12.127872] gitaly[925]: time="2026-08-20T05:48:06.026Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1101696386 clear_duration_ms=0 pid=925 storage=default998gitlab # [ 12.141448] gitaly[925]: time="2026-08-20T05:48:06.057Z" level=info msg="counting repositories" pid=925999gitlab # [ 12.143114] gitaly[925]: time="2026-08-20T05:48:06.057Z" level=info msg="starting to count repositories" pid=925 storage_path=/var/gitlab/state/repositories1000gitlab # [ 12.145789] gitaly[925]: time="2026-08-20T05:48:06.057Z" level=info msg="finished tempdir cleaner walk" pid=925 storage=default time_ms=01001gitlab # [ 12.147976] gitaly[925]: time="2026-08-20T05:48:06.057Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=9251002gitlab # [ 12.151369] gitaly[925]: time="2026-08-20T05:48:06.058Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=925 storage_path=/var/gitlab/state/repositories1003gitlab # [ 12.154800] gitaly[925]: time="2026-08-20T05:48:06.058Z" level=info msg="completed counting all repositories" counting_duration=0 pid=9251004gitlab # [ 12.157470] gitaly[925]: time="2026-08-20T05:48:06.058Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=925 schema=unix1005gitlab # [ 12.160489] gitaly[925]: time="2026-08-20T05:48:06.058Z" level=info msg="listening at address" address=/run/gitaly/gitaly-925/sock.d/intern pid=925 schema=unix1006gitlab # [ 12.163449] gitaly[925]: time="2026-08-20T05:48:06.060Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9251007gitlab # [ 12.166222] gitaly[925]: time="2026-08-20T05:48:06.060Z" level=info msg="Started Gitaly" duration_ms=305 pid=9251008gitlab # [ 12.168301] gitaly[925]: time="2026-08-20T05:48:06.060Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9251009gitlab # [ 12.170933] gitaly[925]: time="2026-08-20T05:48:06.061Z" level=info msg="maintenance: daily scheduled" pid=925 scheduled="2026-08-20 12:00:00 +0000 UTC"1010gitlab # [ 12.485797] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[931]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1011gitlab # [ 12.494224] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[931]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1012gitlab # [ 12.516675] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[931]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1013gitlab # [ 15.239332] dhcpcd[729]: eth0: leased 10.0.2.15 for 86400 seconds1014gitlab # [ 15.239668] dhcpcd[729]: eth0: adding route to 10.0.2.0/241015gitlab # [ 15.239807] dhcpcd[729]: eth0: adding default route via 10.0.2.21016gitlab # [ 15.443381] systemd[1]: Started DHCP Client.1017gitlab # [ 15.447512] systemd[1]: Reached target Network is Online.1018gitlab # [ 15.541742] gitaly[925]: time="2026-08-20T05:48:09.456Z" level=info msg="License database preloaded" duration_ms=3701 pid=9251019gitlab # [ 63.949863] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[931]: W, [2026-08-20T05:48:57.864683 #931] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1020gitlab # [ 67.971044] postgres[1496]: [1496] ERROR: relation "feature_gates" does not exist at character 5231021gitlab # [ 67.972798] postgres[1496]: [1496] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1022gitlab # [ 67.977375] postgres[1496]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1023gitlab # [ 67.981789] postgres[1496]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1024gitlab # [ 67.985723] postgres[1496]: attidentity AS identity,1025gitlab # [ 67.988334] postgres[1496]: attgenerated as attgenerated1026gitlab # [ 67.990947] postgres[1496]: FROM pg_attribute a1027gitlab # [ 67.993119] postgres[1496]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1028gitlab # [ 67.997129] postgres[1496]: LEFT JOIN pg_type t ON a.atttypid = t.oid1029gitlab # [ 67.999982] postgres[1496]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1030gitlab # [ 68.004593] postgres[1496]: WHERE a.attrelid = '"feature_gates"'::regclass1031gitlab # [ 68.007603] postgres[1496]: AND a.attnum > 0 AND NOT a.attisdropped1032gitlab # [ 68.010801] postgres[1496]: ORDER BY a.attnum1033gitlab # [ 68.012965] postgres[1496]:1034gitlab # [ 69.259266] gitlab-workhorse[823]: time="2026-08-20T05:49:03Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1035gitlab # [ 75.474298] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1566]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1036gitlab # [ 75.474772] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1566]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1037gitlab # [ 79.269316] gitlab-workhorse[823]: time="2026-08-20T05:49:13Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1038gitlab # [ 89.270942] gitlab-workhorse[823]: time="2026-08-20T05:49:23Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1039gitlab # [ 99.281378] gitlab-workhorse[823]: time="2026-08-20T05:49:33Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1040gitlab # [ 104.613871] postgres[1686]: [1686] ERROR: relation "table_without_models" does not exist1041gitlab # [ 104.614325] postgres[1686]: [1686] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1042gitlab # [ 109.291708] gitlab-workhorse[823]: time="2026-08-20T05:49:43Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1043gitlab # [ 119.301360] gitlab-workhorse[823]: time="2026-08-20T05:49:53Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1044gitlab # [ 129.305454] gitlab-workhorse[823]: time="2026-08-20T05:50:03Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1045gitlab # [ 138.334993] systemd[1]: Finished gitlab-db-config.service.1046gitlab # [ 138.339904] systemd[1]: Started gitlab-sidekiq.service.1047gitlab # [ 138.344431] systemd[1]: Starting gitlab.service...1048gitlab # [ 138.925615] bundle[2099]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1049gitlab # [ 138.931940] bundle[2099]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1050gitlab # [ 138.937840] bundle[2099]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1051gitlab # [ 139.306902] gitlab-workhorse[823]: time="2026-08-20T05:50:13Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1052gitlab # [ 144.298631] sidekiq-cluster[2098]: {"severity":"INFO","time":"2026-08-20T05:50:18.182Z","message":"Starting cluster with 1 processes"}1053gitlab # [ 144.389962] bundle[2099]: {"timestamp":"2026-08-20T05:50:18.270Z","pid":2099,"message":"* Enabling systemd notification integration"}1054gitlab # [ 144.395008] bundle[2099]: {"timestamp":"2026-08-20T05:50:18.305Z","pid":2099,"message":"Puma starting in cluster mode..."}1055gitlab # [ 144.399541] bundle[2099]: {"timestamp":"2026-08-20T05:50:18.305Z","pid":2099,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1056gitlab # [ 144.404450] bundle[2099]: {"timestamp":"2026-08-20T05:50:18.305Z","pid":2099,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1057gitlab # [ 144.410243] bundle[2099]: {"timestamp":"2026-08-20T05:50:18.305Z","pid":2099,"message":"* Min threads: 0"}1058gitlab # [ 144.414183] bundle[2099]: {"timestamp":"2026-08-20T05:50:18.305Z","pid":2099,"message":"* Max threads: 4"}1059gitlab # [ 144.418153] bundle[2099]: {"timestamp":"2026-08-20T05:50:18.305Z","pid":2099,"message":"* Environment: production"}1060gitlab # [ 144.423070] bundle[2099]: {"timestamp":"2026-08-20T05:50:18.305Z","pid":2099,"message":"* Master PID: 2099"}1061gitlab # [ 144.427472] bundle[2099]: {"timestamp":"2026-08-20T05:50:18.305Z","pid":2099,"message":"* Workers: 2"}1062gitlab # [ 144.431797] bundle[2099]: {"timestamp":"2026-08-20T05:50:18.305Z","pid":2099,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1063gitlab # [ 144.437040] bundle[2099]: {"timestamp":"2026-08-20T05:50:18.305Z","pid":2099,"message":"* Preloading application"}1064gitlab # [ 149.314367] gitlab-workhorse[823]: time="2026-08-20T05:50:23Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1065gitlab # [ 159.322347] gitlab-workhorse[823]: time="2026-08-20T05:50:33Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1066gitlab # [ 169.330251] gitlab-workhorse[823]: time="2026-08-20T05:50:43Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1067gitlab # [ 179.341052] gitlab-workhorse[823]: time="2026-08-20T05:50:53Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1068gitlab # [ 186.834354] bundle[2099]: W, [2026-08-20T05:51:00.749453 #2099] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1069gitlab # [ 189.350518] gitlab-workhorse[823]: time="2026-08-20T05:51:03Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1070gitlab # [ 192.598331] sidekiq-cluster[2156]: 2026-08-20T05:51:06.513Z pid=2156 tid=xqc INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2156, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>432259072}1071gitlab # [ 192.941500] sidekiq-cluster[2156]: W, [2026-08-20T05:51:06.857756 #2156] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1072gitlab # [ 193.012795] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:06.929Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1073gitlab # [ 197.095075] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.010Z","message":"GitLab reliable fetch activated!"}1074gitlab # [ 197.096859] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.010Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1075gitlab # [ 197.137109] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.053Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1076gitlab # [ 197.147470] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.062Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1077gitlab # [ 197.162249] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.078Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1078gitlab # [ 197.173829] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.090Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1079gitlab # [ 197.181382] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.094Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1080gitlab # [ 197.188216] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.097Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1081gitlab # [ 197.194666] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.100Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1082gitlab # [ 197.199939] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.103Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1083gitlab # [ 197.205869] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.105Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1084gitlab # [ 197.210509] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.108Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1085gitlab # [ 197.215685] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.110Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1086gitlab # [ 197.220707] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.113Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1087gitlab # [ 197.225142] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.116Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1088gitlab # [ 197.229751] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.118Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1089gitlab # [ 197.233997] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.123Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1090gitlab # [ 197.238013] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.126Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1091gitlab # [ 197.241591] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.130Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1092gitlab # [ 197.244890] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.134Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1093gitlab # [ 197.248407] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.137Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1094gitlab # [ 197.251569] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.140Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1095gitlab # [ 197.255179] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.144Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1096gitlab # [ 197.258723] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.146Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1097gitlab # [ 197.261677] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.149Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1098gitlab # [ 197.264556] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.152Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1099gitlab # [ 197.267313] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.154Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1100gitlab # [ 197.269972] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.157Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1101gitlab # [ 197.272397] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.160Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1102gitlab # [ 197.274823] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.163Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1103gitlab # [ 197.277411] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.166Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1104gitlab # [ 197.279893] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.169Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1105gitlab # [ 197.282310] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.171Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1106gitlab # [ 197.284828] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.175Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1107gitlab # [ 197.287005] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.177Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1108gitlab # [ 197.289434] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.180Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1109gitlab # [ 197.291687] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.183Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1110gitlab # [ 197.294033] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.185Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1111gitlab # [ 197.296258] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.187Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1112gitlab # [ 197.298318] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.190Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1113gitlab # [ 197.300401] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.192Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1114gitlab # [ 197.302375] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.194Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1115gitlab # [ 197.304553] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.196Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1116gitlab # [ 197.306594] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.198Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1117gitlab # [ 197.308766] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.200Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1118gitlab # [ 197.310744] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.202Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1119gitlab # [ 197.312942] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.205Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1120gitlab # [ 197.315143] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.207Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1121gitlab # [ 197.317353] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.209Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1122gitlab # [ 197.319439] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.211Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1123gitlab # [ 197.321607] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.213Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1124gitlab # [ 197.323661] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.216Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1125gitlab # [ 197.325884] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.218Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1126gitlab # [ 197.327932] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.221Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1127gitlab # [ 197.330141] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.233Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1128gitlab # [ 197.332453] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.236Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1129gitlab # [ 197.334567] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.239Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1130gitlab # [ 197.336716] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.242Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1131gitlab # [ 197.338821] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.244Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1132gitlab # [ 197.341127] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.247Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1133gitlab # [ 197.343256] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.249Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1134gitlab # [ 197.345516] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.251Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1135gitlab # [ 197.347420] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.253Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1136gitlab # [ 197.349432] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.255Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1137gitlab # [ 197.351497] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.258Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1138gitlab # [ 197.353686] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.260Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1139gitlab # [ 197.355830] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.263Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1140gitlab # [ 197.358095] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.265Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1141gitlab # [ 197.360123] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.267Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1142gitlab # [ 197.362227] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.269Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1143gitlab # [ 197.364468] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.270Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1144gitlab # [ 197.366674] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.273Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1145gitlab # [ 197.368903] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.274Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1146gitlab # [ 197.371042] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.276Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1147gitlab # [ 197.373295] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.278Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1148gitlab # [ 197.375575] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.280Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1149gitlab # [ 197.378003] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.281Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1150gitlab # [ 197.380314] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.283Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1151gitlab # [ 197.382461] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.285Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1152gitlab # [ 197.384939] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.287Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1153gitlab # [ 197.387048] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.289Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1154gitlab # [ 197.389209] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.291Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1155gitlab # [ 197.391595] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.293Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1156gitlab # [ 197.394099] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.294Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1157gitlab # [ 197.396332] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.297Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1158gitlab # [ 197.398456] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.299Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1159gitlab # [ 197.400807] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.301Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1160gitlab # [ 197.402952] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.303Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1161gitlab # [ 197.405332] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.306Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1162gitlab # [ 197.407520] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.308Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1163gitlab # [ 197.410970] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.309Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1164gitlab # [ 197.413279] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.311Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1165gitlab # [ 197.415493] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.313Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1166gitlab # [ 197.417835] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.315Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1167gitlab # [ 197.420076] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.316Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1168gitlab # [ 197.422420] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.318Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1169gitlab # [ 197.424423] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.321Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1170gitlab # [ 197.426689] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.323Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1171gitlab # [ 197.428974] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.326Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1172gitlab # [ 197.431176] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.328Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1173gitlab # [ 197.433441] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.341Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1174gitlab # [ 197.435585] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.343Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1175gitlab # [ 197.437848] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.345Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1176gitlab # [ 197.440053] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.349Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1177gitlab # [ 197.442042] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.351Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1178gitlab # [ 197.444166] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.354Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1179gitlab # [ 197.446440] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.357Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1180gitlab # [ 197.448729] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.359Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1181gitlab # [ 197.450718] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.361Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1182gitlab # [ 197.452941] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.364Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1183gitlab # [ 197.495956] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:11.412Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1184gitlab # [ 199.358260] gitlab-workhorse[823]: time="2026-08-20T05:51:13Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1185gitlab # [ 209.359476] gitlab-workhorse[823]: time="2026-08-20T05:51:23Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1186gitlab # [ 219.372529] gitlab-workhorse[823]: time="2026-08-20T05:51:33Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1187gitlab # [ 229.378407] gitlab-workhorse[823]: time="2026-08-20T05:51:43Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1188gitlab # [ 239.386360] gitlab-workhorse[823]: time="2026-08-20T05:51:53Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1189gitlab # [ 240.329255] postgres[2957]: [2957] ERROR: relation "table_without_models" does not exist1190gitlab # [ 240.332519] postgres[2957]: [2957] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1191gitlab # [ 240.715935] postgres[2966]: [2966] ERROR: relation "table_without_models" does not exist1192gitlab # [ 240.719391] postgres[2966]: [2966] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1193gitlab # [ 245.702469] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:59.610Z","message":"Booted Rails 7.2.3.1 application in production environment"}1194gitlab # [ 245.702936] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:59.617Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1195gitlab # [ 245.703070] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:59.617Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1196gitlab # [ 245.703258] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:59.617Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1197gitlab # [ 245.706425] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:51:59.622Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1198gitlab # [ 246.757269] bundle[2099]: {"timestamp":"2026-08-20T05:52:00.672Z","pid":2099,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1199gitlab # [ 246.763081] bundle[2099]: {"timestamp":"2026-08-20T05:52:00.672Z","pid":2099,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1200gitlab # [ 246.768432] bundle[2099]: {"timestamp":"2026-08-20T05:52:00.672Z","pid":2099,"message":"! #\u003cThread:0x0000efd145e3cc20 /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1201gitlab # [ 246.784234] bundle[2099]: {"timestamp":"2026-08-20T05:52:00.672Z","pid":2099,"message":"! #\u003cThread:0x0000efd1460796c8 /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1202gitlab # [ 246.799686] bundle[2099]: {"timestamp":"2026-08-20T05:52:00.673Z","pid":2099,"message":"Use Ctrl-C to stop"}1203gitlab # [ 246.803449] bundle[2099]: {"timestamp":"2026-08-20T05:52:00.673Z","pid":2099,"message":"Sending status to systemd every 1.0 sec"}1204gitlab # [ 247.665404] bundle[2099]: {"timestamp":"2026-08-20T05:52:01.581Z","pid":2099,"message":"- Worker 0 (PID: 3070) booted in 0.84s, phase: 0"}1205gitlab # [ 247.718388] bundle[2099]: {"timestamp":"2026-08-20T05:52:01.634Z","pid":2099,"message":"- Worker 1 (PID: 3074) booted in 0.85s, phase: 0"}1206gitlab # [ 247.730002] systemd[1]: Started gitlab.service.1207gitlab # [ 247.732300] systemd[1]: Reached target Common target for all GitLab services..1208gitlab # [ 247.737491] systemd[1]: Starting setup-gitlab.service...1209gitlab # [ 247.786923] setup-gitlab-start[3107]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1210gitlab # [ 248.756347] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:02.671Z","message":"Cleaning working queues"}1211gitlab # [ 248.761291] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:02.674Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"47a7cd1ec95b863955e3a9cb","created_at":"2026-08-20T05:50:11.568Z","trace_propagation_headers":{"sentry-trace":"710bdbd23ad24814b29184f0639ab7fb-adccad5c71404d49","baggage":"sentry-trace_id=710bdbd23ad24814b29184f0639ab7fb,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"239a5b7ede4b9e8f7c5ea0ce7e25a1b8","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:11.581Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-47a7cd1ec95b863955e3a9cb: start","job_status":"start","queue_duration_s":111.092842,"scheduling_latency_s":111.092965}1212gitlab # [ 249.161067] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:03.076Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"47a7cd1ec95b863955e3a9cb","created_at":"2026-08-20T05:50:11.568Z","trace_propagation_headers":{"sentry-trace":"710bdbd23ad24814b29184f0639ab7fb-adccad5c71404d49","baggage":"sentry-trace_id=710bdbd23ad24814b29184f0639ab7fb,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"239a5b7ede4b9e8f7c5ea0ce7e25a1b8","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:11.581Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-47a7cd1ec95b863955e3a9cb: done: 0.401873 sec","job_status":"done","queue_duration_s":111.092842,"scheduling_latency_s":111.092965,"redis_calls":24,"redis_duration_s":0.012034,"redis_read_bytes":912,"redis_write_bytes":2622,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.006226,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.004017,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001791,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":9,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.198698,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.20798656000000001,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.401873,"completed_at":"2026-08-20T05:52:03.076Z","load_balancing_strategy":"primary","db_duration_s":0.098166,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1213gitlab # [ 251.963352] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/08/20:05:52:05 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 41141214gitlab # [ 251.969622] setup-gitlab-start[3107]: + TOKEN=nixbot-test-token-of-20-chars1215gitlab # [ 251.972861] setup-gitlab-start[3107]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1216gitlab # [ 251.989726] runuser[3145]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1217gitlab # [ 252.590744] setup-gitlab-start[3146]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1218gitlab # [ 252.597496] setup-gitlab-start[3146]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1219gitlab # [ 252.603810] setup-gitlab-start[3146]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1220gitlab # [ 254.186099] setup-gitlab-start[3146]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1221gitlab # [ 254.193237] setup-gitlab-start[3146]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1222gitlab # [ 254.200965] setup-gitlab-start[3146]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1223gitlab # [ 262.487306] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:16.401Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"fedab9320c25a992092f2a44","created_at":"2026-08-20T05:52:16.280Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6ecbe6cab65de2a8130568785ef196b9","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T05:52:16.396Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-fedab9320c25a992092f2a44: start","job_status":"start","queue_duration_s":0.004213,"scheduling_latency_s":0.004342}1224gitlab # [ 262.783634] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:16.698Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"fedab9320c25a992092f2a44","created_at":"2026-08-20T05:52:16.280Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6ecbe6cab65de2a8130568785ef196b9","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T05:52:16.396Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-fedab9320c25a992092f2a44: done: 0.297492 sec","job_status":"done","queue_duration_s":0.004213,"scheduling_latency_s":0.004342,"redis_calls":13,"redis_duration_s":0.027120000000000002,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001566,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.012994,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.01256,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.097444,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0439491,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.297492,"completed_at":"2026-08-20T05:52:16.697Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.048985,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1225gitlab # [ 262.876786] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:16.703Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"035f95d8f3b962813c999f2c","created_at":"2026-08-20T05:52:16.415Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bfb66489639901ca01279e87bf813cda","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T05:52:16.461Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-035f95d8f3b962813c999f2c: start","job_status":"start","queue_duration_s":0.241883,"scheduling_latency_s":0.241944}1226gitlab # [ 263.054950] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:16.969Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"035f95d8f3b962813c999f2c","created_at":"2026-08-20T05:52:16.415Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bfb66489639901ca01279e87bf813cda","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T05:52:16.461Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-035f95d8f3b962813c999f2c: done: 0.265768 sec","job_status":"done","queue_duration_s":0.241883,"scheduling_latency_s":0.241944,"redis_calls":16,"redis_duration_s":0.036287,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.02294,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.01219,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001157,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.038,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.038,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.082829,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00373958,"duration_s":0.265768,"completed_at":"2026-08-20T05:52:16.969Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.109616,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1227gitlab # [ 263.148737] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:16.983Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"cfea7cf493d6b1b83200a5ce","created_at":"2026-08-20T05:52:16.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f9929505d86f89b285c761a645458108","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T05:52:16.493Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-cfea7cf493d6b1b83200a5ce: start","job_status":"start","queue_duration_s":0.489898,"scheduling_latency_s":0.48996}1228gitlab # [ 263.296216] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:17.209Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"cfea7cf493d6b1b83200a5ce","created_at":"2026-08-20T05:52:16.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f9929505d86f89b285c761a645458108","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T05:52:16.493Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-cfea7cf493d6b1b83200a5ce: done: 0.226121 sec","job_status":"done","queue_duration_s":0.489898,"scheduling_latency_s":0.48996,"redis_calls":12,"redis_duration_s":0.035309,"redis_read_bytes":11,"redis_write_bytes":1482,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.004326,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.029262,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001721,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050881,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00077468,"duration_s":0.226121,"completed_at":"2026-08-20T05:52:17.209Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008483,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1229gitlab # [ 263.387066] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:17.212Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"3172a1a1e42008e02a1f70eb","created_at":"2026-08-20T05:52:16.517Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"572e4b6a51314d83df9ab2717e4c3267","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-20T05:52:16.530Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-3172a1a1e42008e02a1f70eb: start","job_status":"start","queue_duration_s":0.681721,"scheduling_latency_s":0.681765}1230gitlab # [ 263.437054] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:17.352Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"3172a1a1e42008e02a1f70eb","created_at":"2026-08-20T05:52:16.517Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"572e4b6a51314d83df9ab2717e4c3267","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-20T05:52:16.530Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-3172a1a1e42008e02a1f70eb: done: 0.139923 sec","job_status":"done","queue_duration_s":0.681721,"scheduling_latency_s":0.681765,"redis_calls":10,"redis_duration_s":0.042728,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.040049,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001806,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000873,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049278,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00074938,"duration_s":0.139923,"completed_at":"2026-08-20T05:52:17.351Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.02729,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1231gitlab # [ 263.507944] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:17.356Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"b6ed5d50d498ba542092843d","created_at":"2026-08-20T05:52:16.556Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"78923625b470cfcf16de403b06666bd8","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-20T05:52:16.569Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-b6ed5d50d498ba542092843d: start","job_status":"start","queue_duration_s":0.786837,"scheduling_latency_s":0.786888}1232gitlab # [ 263.593032] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:17.507Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"b6ed5d50d498ba542092843d","created_at":"2026-08-20T05:52:16.556Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"78923625b470cfcf16de403b06666bd8","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-20T05:52:16.569Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-b6ed5d50d498ba542092843d: done: 0.15093 sec","job_status":"done","queue_duration_s":0.786837,"scheduling_latency_s":0.786888,"redis_calls":12,"redis_duration_s":0.028357,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.022284,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000839,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004385,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000849,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039773,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00080502,"duration_s":0.15093,"completed_at":"2026-08-20T05:52:17.507Z","load_balancing_strategy":"primary","db_duration_s":0.001309,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1233gitlab # [ 263.682431] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:17.517Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"554deecd8c04efbde9184db6","created_at":"2026-08-20T05:52:16.598Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"2d17b4605591cff5a7fd2938cff06591","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-20T05:52:16.649Z","job_size_bytes":3,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-554deecd8c04efbde9184db6: start","job_status":"start","queue_duration_s":0.868392,"scheduling_latency_s":0.868461}1234gitlab # [ 263.717745] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:17.632Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"554deecd8c04efbde9184db6","created_at":"2026-08-20T05:52:16.598Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"2d17b4605591cff5a7fd2938cff06591","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-20T05:52:16.649Z","job_size_bytes":3,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-554deecd8c04efbde9184db6: done: 0.114842 sec","job_status":"done","queue_duration_s":0.868392,"scheduling_latency_s":0.868461,"redis_calls":10,"redis_duration_s":0.012402,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00249,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.008882,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00103,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040819,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00089594,"duration_s":0.114842,"completed_at":"2026-08-20T05:52:17.632Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00329,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1235gitlab # [ 263.771406] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:17.641Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"cb1ee9d04d5eddaecc7a720f","created_at":"2026-08-20T05:52:16.679Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"52b95f97356610835fe78711fec1d9b5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T05:52:16.707Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-cb1ee9d04d5eddaecc7a720f: start","job_status":"start","queue_duration_s":0.93396,"scheduling_latency_s":0.934037}1236gitlab # [ 263.804637] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:17.720Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1237gitlab # [ 263.845791] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:17.761Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"cb1ee9d04d5eddaecc7a720f","created_at":"2026-08-20T05:52:16.679Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"52b95f97356610835fe78711fec1d9b5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T05:52:16.707Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-cb1ee9d04d5eddaecc7a720f: done: 0.118965 sec","job_status":"done","queue_duration_s":0.93396,"scheduling_latency_s":0.934037,"redis_calls":10,"redis_duration_s":0.004584,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000968,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002635,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000981,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.031,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039741,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00083622,"duration_s":0.118965,"completed_at":"2026-08-20T05:52:17.760Z","load_balancing_strategy":"primary","db_duration_s":0.030875,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1238gitlab # [ 263.915498] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:17.766Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"78260cc1b6bf1867d22f26e9","created_at":"2026-08-20T05:52:16.762Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bbaee28a48362a74500138f272fa3f09","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T05:52:16.784Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-78260cc1b6bf1867d22f26e9: start","job_status":"start","queue_duration_s":0.98226,"scheduling_latency_s":0.98232}1239gitlab # [ 264.155620] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:18.070Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"78260cc1b6bf1867d22f26e9","created_at":"2026-08-20T05:52:16.762Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bbaee28a48362a74500138f272fa3f09","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T05:52:16.784Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-78260cc1b6bf1867d22f26e9: done: 0.304409 sec","job_status":"done","queue_duration_s":0.98226,"scheduling_latency_s":0.98232,"redis_calls":14,"redis_duration_s":0.0075049999999999995,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001801,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002789,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002915,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.036,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.028,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.175519,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00203838,"exclusive_lock_hold_duration_s":0.20275279999999998,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.304409,"completed_at":"2026-08-20T05:52:18.070Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.038594,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1240gitlab # [ 264.266082] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:18.074Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"dbbe42b50e6ac9e2d034c517","created_at":"2026-08-20T05:52:16.853Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a657c1a7d7cdcaf5abc5240a70622c1b","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T05:52:16.873Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-dbbe42b50e6ac9e2d034c517: start","job_status":"start","queue_duration_s":1.200977,"scheduling_latency_s":1.201019}1241gitlab # [ 264.287246] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:18.128Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"dbbe42b50e6ac9e2d034c517","created_at":"2026-08-20T05:52:16.853Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a657c1a7d7cdcaf5abc5240a70622c1b","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T05:52:16.873Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-dbbe42b50e6ac9e2d034c517: done: 0.054565 sec","job_status":"done","queue_duration_s":1.200977,"scheduling_latency_s":1.201019,"redis_calls":10,"redis_duration_s":0.003823,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000826,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002213,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000784,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032641,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00093048,"duration_s":0.054565,"completed_at":"2026-08-20T05:52:18.128Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006181,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1242gitlab # [ 264.335665] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:18.131Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"ff481e377d2b07767e4e1ea3","created_at":"2026-08-20T05:52:16.908Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9522919d507c01408282abfd62b8973a","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T05:52:16.936Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-ff481e377d2b07767e4e1ea3: start","job_status":"start","queue_duration_s":1.194745,"scheduling_latency_s":1.194785}1243gitlab # [ 264.351170] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:18.216Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"ff481e377d2b07767e4e1ea3","created_at":"2026-08-20T05:52:16.908Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9522919d507c01408282abfd62b8973a","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T05:52:16.936Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-ff481e377d2b07767e4e1ea3: done: 0.08464 sec","job_status":"done","queue_duration_s":1.194745,"scheduling_latency_s":1.194785,"redis_calls":10,"redis_duration_s":0.004264,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000806,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002579,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000879,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.028,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033797,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00082028,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.08464,"completed_at":"2026-08-20T05:52:18.216Z","load_balancing_strategy":"primary","db_duration_s":0.03244,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1244gitlab # [ 264.395292] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:18.219Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"bd54b796336237718ef53bdb","created_at":"2026-08-20T05:52:16.964Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5a7fa2208d7b3f93314bac3302fb4545","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-20T05:52:16.991Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-bd54b796336237718ef53bdb: start","job_status":"start","queue_duration_s":1.227755,"scheduling_latency_s":1.227795}1245gitlab # [ 264.410436] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:18.282Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"bd54b796336237718ef53bdb","created_at":"2026-08-20T05:52:16.964Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5a7fa2208d7b3f93314bac3302fb4545","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-20T05:52:16.991Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-bd54b796336237718ef53bdb: done: 0.06265 sec","job_status":"done","queue_duration_s":1.227755,"scheduling_latency_s":1.227795,"redis_calls":12,"redis_duration_s":0.008636,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000683,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001646,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.006307,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032511,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00088752,"exclusive_lock_hold_duration_s":0.0120312,"duration_s":0.06265,"completed_at":"2026-08-20T05:52:18.281Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009653,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1246gitlab # [ 264.455542] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:18.284Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"c2fca7b77bb31ba7e098fa26","created_at":"2026-08-20T05:52:17.028Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"41b5c12bb5970497da4d07eee1c83156","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T05:52:17.042Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-c2fca7b77bb31ba7e098fa26: start","job_status":"start","queue_duration_s":1.2422,"scheduling_latency_s":1.24223}1247gitlab # [ 264.470833] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:18.361Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"c2fca7b77bb31ba7e098fa26","created_at":"2026-08-20T05:52:17.028Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"41b5c12bb5970497da4d07eee1c83156","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T05:52:17.042Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-c2fca7b77bb31ba7e098fa26: done: 0.076861 sec","job_status":"done","queue_duration_s":1.2422,"scheduling_latency_s":1.24223,"redis_calls":12,"redis_duration_s":0.002818,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000367,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001364,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001087,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.028,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035762,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00073188,"exclusive_lock_hold_duration_s":0.0315043,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.076861,"completed_at":"2026-08-20T05:52:18.360Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.029093,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1248gitlab # [ 264.516857] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:18.363Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"b34f43a05c33260e26195798","created_at":"2026-08-20T05:52:17.052Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8d18c323c0b78aab268ab4e7087af3c7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T05:52:17.063Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-b34f43a05c33260e26195798: start","job_status":"start","queue_duration_s":1.299901,"scheduling_latency_s":1.29993}1249gitlab # [ 264.531677] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:18.383Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1250gitlab # [ 264.535545] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:18.394Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"b34f43a05c33260e26195798","created_at":"2026-08-20T05:52:17.052Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8d18c323c0b78aab268ab4e7087af3c7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T05:52:17.063Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-b34f43a05c33260e26195798: done: 0.031141 sec","job_status":"done","queue_duration_s":1.299901,"scheduling_latency_s":1.29993,"redis_calls":10,"redis_duration_s":0.001936,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000384,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001095,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000457,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018582,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032766,"duration_s":0.031141,"completed_at":"2026-08-20T05:52:18.394Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00087,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1251gitlab # [ 264.579046] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:18.396Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"6e74e550f73de846bf469164","created_at":"2026-08-20T05:52:17.071Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6df04d1fcba8158e378388155eb9c326","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T05:52:17.080Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-6e74e550f73de846bf469164: start","job_status":"start","queue_duration_s":1.316071,"scheduling_latency_s":1.316095}1252gitlab # [ 264.594001] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:18.414Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1253gitlab # [ 264.597900] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:18.425Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"6e74e550f73de846bf469164","created_at":"2026-08-20T05:52:17.071Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6df04d1fcba8158e378388155eb9c326","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T05:52:17.080Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-6e74e550f73de846bf469164: done: 0.029195 sec","job_status":"done","queue_duration_s":1.316071,"scheduling_latency_s":1.316095,"redis_calls":10,"redis_duration_s":0.002439,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000704,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00134,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000395,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017304,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0005671,"duration_s":0.029195,"completed_at":"2026-08-20T05:52:18.425Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000992,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1254gitlab # [ 264.642918] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:18.427Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"51760161a48118de53d02f9a","created_at":"2026-08-20T05:52:17.091Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9dc8d6239e17611a699e9cc7ebd40786","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T05:52:17.114Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-51760161a48118de53d02f9a: start","job_status":"start","queue_duration_s":1.313321,"scheduling_latency_s":1.313349}1255gitlab # [ 264.823726] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:18.739Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"51760161a48118de53d02f9a","created_at":"2026-08-20T05:52:17.091Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9dc8d6239e17611a699e9cc7ebd40786","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T05:52:17.114Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-51760161a48118de53d02f9a: done: 0.312067 sec","job_status":"done","queue_duration_s":1.313321,"scheduling_latency_s":1.313349,"redis_calls":14,"redis_duration_s":0.0032430000000000002,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000719,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00131,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001214,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.055,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.055,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.236876,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00062348,"exclusive_lock_hold_duration_s":0.28091228,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.312067,"completed_at":"2026-08-20T05:52:18.739Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.085944,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1256gitlab # [ 264.922393] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:18.741Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"4a93762c3da6f9bf50e9cbf2","created_at":"2026-08-20T05:52:17.140Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7303aaa31d20022aa09163d82f76ea44","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T05:52:17.174Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-4a93762c3da6f9bf50e9cbf2: start","job_status":"start","queue_duration_s":1.567371,"scheduling_latency_s":1.567397}1257gitlab # [ 265.272095] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.188Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"4a93762c3da6f9bf50e9cbf2","created_at":"2026-08-20T05:52:17.140Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7303aaa31d20022aa09163d82f76ea44","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T05:52:17.174Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-4a93762c3da6f9bf50e9cbf2: done: 0.446316 sec","job_status":"done","queue_duration_s":1.567371,"scheduling_latency_s":1.567397,"redis_calls":565,"redis_duration_s":0.120237,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000639,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001522,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.118076,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.364995,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037246,"duration_s":0.446316,"completed_at":"2026-08-20T05:52:19.187Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000915,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1258gitlab # [ 265.370194] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.189Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"8a166536847e65611e98594a","created_at":"2026-08-20T05:52:17.204Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8a85b822ae522d5101ef192ecd81aae5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T05:52:17.236Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-8a166536847e65611e98594a: start","job_status":"start","queue_duration_s":1.953006,"scheduling_latency_s":1.953035}1259gitlab # [ 265.388211] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.211Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1260gitlab # [ 265.392097] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.234Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"8a166536847e65611e98594a","created_at":"2026-08-20T05:52:17.204Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8a85b822ae522d5101ef192ecd81aae5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T05:52:17.236Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-8a166536847e65611e98594a: done: 0.04454 sec","job_status":"done","queue_duration_s":1.953006,"scheduling_latency_s":1.953035,"redis_calls":10,"redis_duration_s":0.003661,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000862,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002167,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000632,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026281,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00064002,"duration_s":0.04454,"completed_at":"2026-08-20T05:52:19.234Z","load_balancing_strategy":"primary","db_duration_s":0.000934,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1261gitlab # [ 265.435653] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.237Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"8263563c9ecd9b01eeae9aa0","created_at":"2026-08-20T05:52:17.291Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"30533fb5e79ca27fa00147a5cddcd761","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T05:52:17.326Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-8263563c9ecd9b01eeae9aa0: start","job_status":"start","queue_duration_s":1.911242,"scheduling_latency_s":1.911287}1262gitlab # [ 265.449497] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.329Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"8263563c9ecd9b01eeae9aa0","created_at":"2026-08-20T05:52:17.291Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"30533fb5e79ca27fa00147a5cddcd761","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T05:52:17.326Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-8263563c9ecd9b01eeae9aa0: done: 0.091795 sec","job_status":"done","queue_duration_s":1.911242,"scheduling_latency_s":1.911287,"redis_calls":19,"redis_duration_s":0.013648,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001858,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.00205,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.008723,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001017,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.063665,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004939,"duration_s":0.091795,"completed_at":"2026-08-20T05:52:19.329Z","load_balancing_strategy":"primary","db_duration_s":0.003979,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1263gitlab # [ 265.492337] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.331Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"2e0a82bbbebf869af945badf","created_at":"2026-08-20T05:52:17.385Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3b02d1a65930272753b9c5b3613bf9e9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T05:52:17.405Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-2e0a82bbbebf869af945badf: start","job_status":"start","queue_duration_s":1.92616,"scheduling_latency_s":1.926199}1264gitlab # [ 265.506698] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.352Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1265gitlab # [ 265.509922] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.364Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"2e0a82bbbebf869af945badf","created_at":"2026-08-20T05:52:17.385Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3b02d1a65930272753b9c5b3613bf9e9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T05:52:17.405Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-2e0a82bbbebf869af945badf: done: 0.032566 sec","job_status":"done","queue_duration_s":1.92616,"scheduling_latency_s":1.926199,"redis_calls":10,"redis_duration_s":0.002252,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000516,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001242,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000494,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019237,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003636,"duration_s":0.032566,"completed_at":"2026-08-20T05:52:19.364Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001004,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1266gitlab # [ 265.552316] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.366Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"7504ef59ce28f2ec204bc5cd","created_at":"2026-08-20T05:52:17.464Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b069d7a119f1f2f1eb49ddd815abacc0","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T05:52:17.502Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-7504ef59ce28f2ec204bc5cd: start","job_status":"start","queue_duration_s":1.864022,"scheduling_latency_s":1.864059}1267gitlab # [ 265.566664] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.405Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"7504ef59ce28f2ec204bc5cd","created_at":"2026-08-20T05:52:17.464Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b069d7a119f1f2f1eb49ddd815abacc0","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T05:52:17.502Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-7504ef59ce28f2ec204bc5cd: done: 0.039051 sec","job_status":"done","queue_duration_s":1.864022,"scheduling_latency_s":1.864059,"redis_calls":12,"redis_duration_s":0.0027199999999999998,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000461,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001202,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001057,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023425,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00075932,"exclusive_lock_hold_duration_s":0.0055553,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.039051,"completed_at":"2026-08-20T05:52:19.405Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003201,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1268gitlab # [ 265.611987] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.407Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"015b0426accf60f7478ff554","created_at":"2026-08-20T05:52:17.533Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"594ca04599104ad2d282caff2087105f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T05:52:17.571Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-015b0426accf60f7478ff554: start","job_status":"start","queue_duration_s":1.836057,"scheduling_latency_s":1.836089}1269gitlab # [ 265.625713] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.447Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"015b0426accf60f7478ff554","created_at":"2026-08-20T05:52:17.533Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"594ca04599104ad2d282caff2087105f","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T05:52:17.571Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-015b0426accf60f7478ff554: done: 0.039826 sec","job_status":"done","queue_duration_s":1.836057,"scheduling_latency_s":1.836089,"redis_calls":12,"redis_duration_s":0.00227,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000386,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001017,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000867,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023369,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00062762,"exclusive_lock_hold_duration_s":0.01207964,"duration_s":0.039826,"completed_at":"2026-08-20T05:52:19.447Z","load_balancing_strategy":"primary","db_duration_s":0.006164,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1270gitlab # [ 265.667040] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.449Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"8aa39c9a1a181b6640c08e94","created_at":"2026-08-20T05:52:17.621Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T05:52:17.650Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-8aa39c9a1a181b6640c08e94: start","job_status":"start","queue_duration_s":1.798451,"scheduling_latency_s":1.798479}1271gitlab # [ 265.681244] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.574Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"8aa39c9a1a181b6640c08e94","created_at":"2026-08-20T05:52:17.621Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T05:52:17.650Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-8aa39c9a1a181b6640c08e94: done: 0.124896 sec","job_status":"done","queue_duration_s":1.798451,"scheduling_latency_s":1.798479,"redis_calls":71,"redis_duration_s":0.012144,"redis_read_bytes":120,"redis_write_bytes":42574,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.001813,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000911,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37385,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.008847,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000573,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.108778,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002693,"duration_s":0.124896,"completed_at":"2026-08-20T05:52:19.574Z","load_balancing_strategy":"primary","db_duration_s":0.003367,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1272gitlab # [ 265.724455] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.575Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"160c459930830d0bdfc76c59","created_at":"2026-08-20T05:52:17.706Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"831542ba3f218247356048287da81ef5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T05:52:17.755Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-160c459930830d0bdfc76c59: start","job_status":"start","queue_duration_s":1.819932,"scheduling_latency_s":1.819958}1273gitlab # [ 265.739203] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.600Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"160c459930830d0bdfc76c59","created_at":"2026-08-20T05:52:17.706Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"831542ba3f218247356048287da81ef5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T05:52:17.755Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-160c459930830d0bdfc76c59: done: 0.024412 sec","job_status":"done","queue_duration_s":1.819932,"scheduling_latency_s":1.819958,"redis_calls":10,"redis_duration_s":0.001492,"redis_read_bytes":9,"redis_write_bytes":1299,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000315,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000865,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000312,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014167,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002583,"duration_s":0.024412,"completed_at":"2026-08-20T05:52:19.599Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00198,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1274gitlab # [ 265.782953] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.601Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"fb1cfe7033781b31db32e0a0","created_at":"2026-08-20T05:52:17.782Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5aea5596f808c365f070a0533d2a6306","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T05:52:17.838Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-fb1cfe7033781b31db32e0a0: start","job_status":"start","queue_duration_s":1.763002,"scheduling_latency_s":1.763028}1275gitlab # [ 265.797749] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.615Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1276gitlab # [ 265.801022] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.624Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"fb1cfe7033781b31db32e0a0","created_at":"2026-08-20T05:52:17.782Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5aea5596f808c365f070a0533d2a6306","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T05:52:17.838Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-fb1cfe7033781b31db32e0a0: done: 0.022998 sec","job_status":"done","queue_duration_s":1.763002,"scheduling_latency_s":1.763028,"redis_calls":10,"redis_duration_s":0.001784,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000326,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001131,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000327,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013229,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00057518,"duration_s":0.022998,"completed_at":"2026-08-20T05:52:19.624Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000763,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1277gitlab # [ 265.843464] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.626Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"759c950bbc97c068b38f58a9","created_at":"2026-08-20T05:52:17.912Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a26f532ed0d00d4e4abf16aeec06e631","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T05:52:17.932Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-759c950bbc97c068b38f58a9: start","job_status":"start","queue_duration_s":1.693933,"scheduling_latency_s":1.693963}1278gitlab # [ 265.856798] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.666Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"759c950bbc97c068b38f58a9","created_at":"2026-08-20T05:52:17.912Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a26f532ed0d00d4e4abf16aeec06e631","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T05:52:17.932Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-759c950bbc97c068b38f58a9: done: 0.040369 sec","job_status":"done","queue_duration_s":1.693933,"scheduling_latency_s":1.693963,"redis_calls":10,"redis_duration_s":0.00163,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000372,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000883,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000375,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025583,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026492,"duration_s":0.040369,"completed_at":"2026-08-20T05:52:19.666Z","load_balancing_strategy":"primary","db_duration_s":0.006863,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1279gitlab # [ 265.897319] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.668Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"01b2b42e480e7108486fafd0","created_at":"2026-08-20T05:52:19.275Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-a80659c7809441f6","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"30533fb5e79ca27fa00147a5cddcd761","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.310Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-01b2b42e480e7108486fafd0: start","job_status":"start","queue_duration_s":0.357137,"scheduling_latency_s":0.357162}1280gitlab # [ 265.909556] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.688Z","message":"No existing merge request to be cleaned up."}1281gitlab # [ 265.911520] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.705Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"01b2b42e480e7108486fafd0","created_at":"2026-08-20T05:52:19.275Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-a80659c7809441f6","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"30533fb5e79ca27fa00147a5cddcd761","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.310Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-01b2b42e480e7108486fafd0: done: 0.037129 sec","job_status":"done","queue_duration_s":0.357137,"scheduling_latency_s":0.357162,"redis_calls":13,"redis_duration_s":0.0024820000000000003,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000351,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000745,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001386,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023453,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025726,"duration_s":0.037129,"completed_at":"2026-08-20T05:52:19.705Z","load_balancing_strategy":"primary","db_duration_s":0.006064,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1282gitlab # [ 265.952060] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.706Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"61433458ab787b68fe28fa57","created_at":"2026-08-20T05:52:19.275Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-a80659c7809441f6","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"30533fb5e79ca27fa00147a5cddcd761","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.310Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-61433458ab787b68fe28fa57: start","job_status":"start","queue_duration_s":0.395611,"scheduling_latency_s":0.395634}1283gitlab # [ 265.964277] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.720Z","message":"No existing merge request to be cleaned up."}1284gitlab # [ 265.965930] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.730Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"61433458ab787b68fe28fa57","created_at":"2026-08-20T05:52:19.275Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-a80659c7809441f6","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"30533fb5e79ca27fa00147a5cddcd761","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.310Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-61433458ab787b68fe28fa57: done: 0.02438 sec","job_status":"done","queue_duration_s":0.395611,"scheduling_latency_s":0.395634,"redis_calls":10,"redis_duration_s":0.001649,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000675,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000974,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016281,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02438,"completed_at":"2026-08-20T05:52:19.730Z","load_balancing_strategy":"primary","db_duration_s":0.003316,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1285gitlab # [ 266.005159] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.732Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"91a8d35a81665f0f847dc6cd","created_at":"2026-08-20T05:52:19.275Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-a80659c7809441f6","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"30533fb5e79ca27fa00147a5cddcd761","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.310Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-91a8d35a81665f0f847dc6cd: start","job_status":"start","queue_duration_s":0.421242,"scheduling_latency_s":0.421263}1286gitlab # [ 266.017382] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.744Z","message":"No existing merge request to be cleaned up."}1287gitlab # [ 266.019017] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.755Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"91a8d35a81665f0f847dc6cd","created_at":"2026-08-20T05:52:19.275Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-a80659c7809441f6","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"30533fb5e79ca27fa00147a5cddcd761","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.310Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-91a8d35a81665f0f847dc6cd: done: 0.023038 sec","job_status":"done","queue_duration_s":0.421242,"scheduling_latency_s":0.421263,"redis_calls":10,"redis_duration_s":0.001449,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000641,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000808,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014841,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023038,"completed_at":"2026-08-20T05:52:19.755Z","load_balancing_strategy":"primary","db_duration_s":0.002616,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1288gitlab # [ 266.057562] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.756Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1cb310aa4c7dd58ed0e1cfe8","created_at":"2026-08-20T05:52:19.275Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-a80659c7809441f6","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"30533fb5e79ca27fa00147a5cddcd761","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.310Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1cb310aa4c7dd58ed0e1cfe8: start","job_status":"start","queue_duration_s":0.445675,"scheduling_latency_s":0.445694}1289gitlab # [ 266.069767] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.769Z","message":"No existing merge request to be cleaned up."}1290gitlab # [ 266.071425] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.778Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1cb310aa4c7dd58ed0e1cfe8","created_at":"2026-08-20T05:52:19.275Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-a80659c7809441f6","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"30533fb5e79ca27fa00147a5cddcd761","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.310Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1cb310aa4c7dd58ed0e1cfe8: done: 0.022191 sec","job_status":"done","queue_duration_s":0.445675,"scheduling_latency_s":0.445694,"redis_calls":10,"redis_duration_s":0.0014420000000000001,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000612,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00083,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015022,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022191,"completed_at":"2026-08-20T05:52:19.778Z","load_balancing_strategy":"primary","db_duration_s":0.002967,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1291gitlab # [ 266.109850] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.780Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0dcda7b65fcf6d01e5baa97f","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0dcda7b65fcf6d01e5baa97f: start","job_status":"start","queue_duration_s":0.216637,"scheduling_latency_s":0.216658}1292gitlab # [ 266.122264] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.807Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0dcda7b65fcf6d01e5baa97f","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0dcda7b65fcf6d01e5baa97f: done: 0.027457 sec","job_status":"done","queue_duration_s":0.216637,"scheduling_latency_s":0.216658,"redis_calls":16,"redis_duration_s":0.002391,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000362,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000708,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001321,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017274,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00028112,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027457,"completed_at":"2026-08-20T05:52:19.807Z","load_balancing_strategy":"primary","db_duration_s":0.00073,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1293gitlab # [ 266.162953] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.809Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ccc365776d3cb1feb61d017","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ccc365776d3cb1feb61d017: start","job_status":"start","queue_duration_s":0.245457,"scheduling_latency_s":0.245477}1294gitlab # [ 266.175285] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.826Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ccc365776d3cb1feb61d017","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ccc365776d3cb1feb61d017: done: 0.017413 sec","job_status":"done","queue_duration_s":0.245457,"scheduling_latency_s":0.245477,"redis_calls":13,"redis_duration_s":0.001781,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001232,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011517,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017413,"completed_at":"2026-08-20T05:52:19.826Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1295gitlab # [ 266.215729] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.827Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abdae97d8b655e250a2b6d8a","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abdae97d8b655e250a2b6d8a: start","job_status":"start","queue_duration_s":0.264247,"scheduling_latency_s":0.264265}1296gitlab # [ 266.228590] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.844Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abdae97d8b655e250a2b6d8a","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abdae97d8b655e250a2b6d8a: done: 0.016429 sec","job_status":"done","queue_duration_s":0.264247,"scheduling_latency_s":0.264265,"redis_calls":13,"redis_duration_s":0.0015270000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000554,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000973,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011134,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016429,"completed_at":"2026-08-20T05:52:19.844Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1297gitlab # [ 266.267983] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.845Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"11fdaaaa73db06dc88315983","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-11fdaaaa73db06dc88315983: start","job_status":"start","queue_duration_s":0.282171,"scheduling_latency_s":0.282188}1298gitlab # [ 266.280342] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.862Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"11fdaaaa73db06dc88315983","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-11fdaaaa73db06dc88315983: done: 0.016444 sec","job_status":"done","queue_duration_s":0.282171,"scheduling_latency_s":0.282188,"redis_calls":13,"redis_duration_s":0.0015609999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000579,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000982,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011216,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016444,"completed_at":"2026-08-20T05:52:19.862Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1299gitlab # [ 266.319280] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.863Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"59914e5435ae0e3dc00da43c","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-59914e5435ae0e3dc00da43c: start","job_status":"start","queue_duration_s":0.300066,"scheduling_latency_s":0.300084}1300gitlab # [ 266.331454] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.880Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"59914e5435ae0e3dc00da43c","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-59914e5435ae0e3dc00da43c: done: 0.016953 sec","job_status":"done","queue_duration_s":0.300066,"scheduling_latency_s":0.300084,"redis_calls":13,"redis_duration_s":0.001591,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000605,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000986,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011818,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016953,"completed_at":"2026-08-20T05:52:19.880Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1301gitlab # [ 266.370951] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.882Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e7fd8643a5b3a39e5f29b34b","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e7fd8643a5b3a39e5f29b34b: start","job_status":"start","queue_duration_s":0.319048,"scheduling_latency_s":0.319067}1302gitlab # [ 266.383483] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.900Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e7fd8643a5b3a39e5f29b34b","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e7fd8643a5b3a39e5f29b34b: done: 0.01746 sec","job_status":"done","queue_duration_s":0.319048,"scheduling_latency_s":0.319067,"redis_calls":13,"redis_duration_s":0.001696,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000613,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001083,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012104,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01746,"completed_at":"2026-08-20T05:52:19.900Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1303gitlab # [ 266.425062] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.901Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad80718c433c1d1746070201","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad80718c433c1d1746070201: start","job_status":"start","queue_duration_s":0.338026,"scheduling_latency_s":0.338045}1304gitlab # [ 266.437755] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.927Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad80718c433c1d1746070201","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad80718c433c1d1746070201: done: 0.026046 sec","job_status":"done","queue_duration_s":0.338026,"scheduling_latency_s":0.338045,"redis_calls":13,"redis_duration_s":0.0041930000000000005,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003098,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001095,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014874,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026046,"completed_at":"2026-08-20T05:52:19.927Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1305gitlab # [ 266.477957] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.931Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a50c3337c378856e3c359453","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a50c3337c378856e3c359453: start","job_status":"start","queue_duration_s":0.367604,"scheduling_latency_s":0.367649}1306gitlab # [ 266.490630] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.973Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a50c3337c378856e3c359453","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a50c3337c378856e3c359453: done: 0.041803 sec","job_status":"done","queue_duration_s":0.367604,"scheduling_latency_s":0.367649,"redis_calls":13,"redis_duration_s":0.0038779999999999995,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001282,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002596,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029511,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.041803,"completed_at":"2026-08-20T05:52:19.972Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1307gitlab # [ 266.530455] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:19.976Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e515cc57e8dd955229f40046","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e515cc57e8dd955229f40046: start","job_status":"start","queue_duration_s":0.412814,"scheduling_latency_s":0.412859}1308gitlab # [ 266.542944] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.011Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e515cc57e8dd955229f40046","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e515cc57e8dd955229f40046: done: 0.034844 sec","job_status":"done","queue_duration_s":0.412814,"scheduling_latency_s":0.412859,"redis_calls":13,"redis_duration_s":0.003688,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001352,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002336,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022429,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034844,"completed_at":"2026-08-20T05:52:20.011Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1309gitlab # [ 266.583418] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.014Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4ddee8edde8b067d3a452b8a","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4ddee8edde8b067d3a452b8a: start","job_status":"start","queue_duration_s":0.450297,"scheduling_latency_s":0.450338}1310gitlab # [ 266.597466] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.041Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4ddee8edde8b067d3a452b8a","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4ddee8edde8b067d3a452b8a: done: 0.028036 sec","job_status":"done","queue_duration_s":0.450297,"scheduling_latency_s":0.450338,"redis_calls":13,"redis_duration_s":0.0034980000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001181,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002317,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017942,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028036,"completed_at":"2026-08-20T05:52:20.041Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1311gitlab # [ 266.636910] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.044Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98cc676743f0ad0b5d67b352","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98cc676743f0ad0b5d67b352: start","job_status":"start","queue_duration_s":0.480694,"scheduling_latency_s":0.480731}1312gitlab # [ 266.649417] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.073Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98cc676743f0ad0b5d67b352","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98cc676743f0ad0b5d67b352: done: 0.02949 sec","job_status":"done","queue_duration_s":0.480694,"scheduling_latency_s":0.480731,"redis_calls":13,"redis_duration_s":0.006353,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001268,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005085,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017387,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02949,"completed_at":"2026-08-20T05:52:20.073Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1313gitlab # [ 266.688908] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.076Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39cfc1060a5e20ef46b202e5","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39cfc1060a5e20ef46b202e5: start","job_status":"start","queue_duration_s":0.512459,"scheduling_latency_s":0.512491}1314gitlab # [ 266.701342] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.097Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39cfc1060a5e20ef46b202e5","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39cfc1060a5e20ef46b202e5: done: 0.021475 sec","job_status":"done","queue_duration_s":0.512459,"scheduling_latency_s":0.512491,"redis_calls":13,"redis_duration_s":0.003054,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001112,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001942,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013591,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021475,"completed_at":"2026-08-20T05:52:20.097Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1315gitlab # [ 266.740777] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.099Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e5ba20bc0fa16bf47ac8a5e2","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e5ba20bc0fa16bf47ac8a5e2: start","job_status":"start","queue_duration_s":0.535576,"scheduling_latency_s":0.535596}1316gitlab # [ 266.753233] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.117Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e5ba20bc0fa16bf47ac8a5e2","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e5ba20bc0fa16bf47ac8a5e2: done: 0.018442 sec","job_status":"done","queue_duration_s":0.535576,"scheduling_latency_s":0.535596,"redis_calls":13,"redis_duration_s":0.002687,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00095,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001737,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011642,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018442,"completed_at":"2026-08-20T05:52:20.117Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1317gitlab # [ 266.793734] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.119Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"764177e2575d32fa103b7548","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-764177e2575d32fa103b7548: start","job_status":"start","queue_duration_s":0.555543,"scheduling_latency_s":0.555566}1318gitlab # [ 266.806412] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.138Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"764177e2575d32fa103b7548","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-764177e2575d32fa103b7548: done: 0.018853 sec","job_status":"done","queue_duration_s":0.555543,"scheduling_latency_s":0.555566,"redis_calls":13,"redis_duration_s":0.003252,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001079,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002173,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011186,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018853,"completed_at":"2026-08-20T05:52:20.138Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1319gitlab # [ 266.846118] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.139Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c16c3148bff394957f400eae","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c16c3148bff394957f400eae: start","job_status":"start","queue_duration_s":0.576154,"scheduling_latency_s":0.576172}1320gitlab # [ 266.858743] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.158Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c16c3148bff394957f400eae","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c16c3148bff394957f400eae: done: 0.018494 sec","job_status":"done","queue_duration_s":0.576154,"scheduling_latency_s":0.576172,"redis_calls":13,"redis_duration_s":0.002972,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001013,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001959,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011014,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018494,"completed_at":"2026-08-20T05:52:20.158Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1321gitlab # [ 266.898075] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.159Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"15b08aea5910537a97f416d0","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-15b08aea5910537a97f416d0: start","job_status":"start","queue_duration_s":0.596093,"scheduling_latency_s":0.596109}1322gitlab # [ 266.910682] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.176Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"15b08aea5910537a97f416d0","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-15b08aea5910537a97f416d0: done: 0.016952 sec","job_status":"done","queue_duration_s":0.596093,"scheduling_latency_s":0.596109,"redis_calls":13,"redis_duration_s":0.002802,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000963,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001839,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010375,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016952,"completed_at":"2026-08-20T05:52:20.176Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1323gitlab # [ 266.950273] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.178Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"86c3ea86c080cff170532406","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-86c3ea86c080cff170532406: start","job_status":"start","queue_duration_s":0.614509,"scheduling_latency_s":0.614526}1324gitlab # [ 266.962571] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.194Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"86c3ea86c080cff170532406","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-86c3ea86c080cff170532406: done: 0.01667 sec","job_status":"done","queue_duration_s":0.614509,"scheduling_latency_s":0.614526,"redis_calls":13,"redis_duration_s":0.0027689999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000928,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001841,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01667,"completed_at":"2026-08-20T05:52:20.194Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1325gitlab # [ 267.003654] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.196Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8ac45f9ebde2fd9bd370ed1","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8ac45f9ebde2fd9bd370ed1: start","job_status":"start","queue_duration_s":0.632846,"scheduling_latency_s":0.632862}1326gitlab # [ 267.016906] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.214Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8ac45f9ebde2fd9bd370ed1","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8ac45f9ebde2fd9bd370ed1: done: 0.017696 sec","job_status":"done","queue_duration_s":0.632846,"scheduling_latency_s":0.632862,"redis_calls":13,"redis_duration_s":0.002824,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001023,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001801,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011161,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017696,"completed_at":"2026-08-20T05:52:20.214Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1327gitlab # [ 267.056337] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.216Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01f6fb65854a70d8a4b0038d","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01f6fb65854a70d8a4b0038d: start","job_status":"start","queue_duration_s":0.65236,"scheduling_latency_s":0.652377}1328gitlab # [ 267.068977] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.233Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01f6fb65854a70d8a4b0038d","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01f6fb65854a70d8a4b0038d: done: 0.01786 sec","job_status":"done","queue_duration_s":0.65236,"scheduling_latency_s":0.652377,"redis_calls":13,"redis_duration_s":0.003366,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001428,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001938,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011126,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01786,"completed_at":"2026-08-20T05:52:20.233Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1329gitlab # [ 267.108870] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.235Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5a891d0eb27172b7d83b818","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5a891d0eb27172b7d83b818: start","job_status":"start","queue_duration_s":0.671812,"scheduling_latency_s":0.671828}1330gitlab # [ 267.121062] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.253Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5a891d0eb27172b7d83b818","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5a891d0eb27172b7d83b818: done: 0.017846 sec","job_status":"done","queue_duration_s":0.671812,"scheduling_latency_s":0.671828,"redis_calls":13,"redis_duration_s":0.003522,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000951,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002571,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010957,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017846,"completed_at":"2026-08-20T05:52:20.253Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1331gitlab # [ 267.161012] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.254Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4c67ac23dd8d64593375b949","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4c67ac23dd8d64593375b949: start","job_status":"start","queue_duration_s":0.691283,"scheduling_latency_s":0.6913}1332gitlab # [ 267.173699] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.272Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4c67ac23dd8d64593375b949","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4c67ac23dd8d64593375b949: done: 0.017854 sec","job_status":"done","queue_duration_s":0.691283,"scheduling_latency_s":0.6913,"redis_calls":13,"redis_duration_s":0.002951,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001079,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001872,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011374,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017854,"completed_at":"2026-08-20T05:52:20.272Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1333gitlab # [ 267.214621] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.274Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"552bff89e4bb593d68ef488e","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-552bff89e4bb593d68ef488e: start","job_status":"start","queue_duration_s":0.711075,"scheduling_latency_s":0.711096}1334gitlab # [ 267.227367] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.293Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"552bff89e4bb593d68ef488e","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-552bff89e4bb593d68ef488e: done: 0.018457 sec","job_status":"done","queue_duration_s":0.711075,"scheduling_latency_s":0.711096,"redis_calls":13,"redis_duration_s":0.0029100000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001043,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001867,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011783,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018457,"completed_at":"2026-08-20T05:52:20.293Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1335gitlab # [ 267.267382] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.294Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"67e21de117d1dc5e0e8d949b","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-67e21de117d1dc5e0e8d949b: start","job_status":"start","queue_duration_s":0.731155,"scheduling_latency_s":0.731173}1336gitlab # [ 267.280245] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.314Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"67e21de117d1dc5e0e8d949b","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-67e21de117d1dc5e0e8d949b: done: 0.0193 sec","job_status":"done","queue_duration_s":0.731155,"scheduling_latency_s":0.731173,"redis_calls":13,"redis_duration_s":0.003194,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001044,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00215,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012171,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0193,"completed_at":"2026-08-20T05:52:20.314Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1337gitlab # [ 267.320105] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.315Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d2134cb81a130217c75356fe","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d2134cb81a130217c75356fe: start","job_status":"start","queue_duration_s":0.75209,"scheduling_latency_s":0.752108}1338gitlab # [ 267.332209] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.338Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d2134cb81a130217c75356fe","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d2134cb81a130217c75356fe: done: 0.022529 sec","job_status":"done","queue_duration_s":0.75209,"scheduling_latency_s":0.752108,"redis_calls":13,"redis_duration_s":0.004712,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002192,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00252,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013152,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022529,"completed_at":"2026-08-20T05:52:20.338Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1339gitlab # [ 267.372253] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.342Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a09d565cdb5637bdcee4bb12","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a09d565cdb5637bdcee4bb12: start","job_status":"start","queue_duration_s":0.778561,"scheduling_latency_s":0.778596}1340gitlab # [ 267.384731] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.377Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a09d565cdb5637bdcee4bb12","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a09d565cdb5637bdcee4bb12: done: 0.035116 sec","job_status":"done","queue_duration_s":0.778561,"scheduling_latency_s":0.778596,"redis_calls":13,"redis_duration_s":0.010214,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.007019,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003195,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015196,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035116,"completed_at":"2026-08-20T05:52:20.377Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1341gitlab # [ 267.425333] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.382Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d8146d5fabed8f38d5f6533","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d8146d5fabed8f38d5f6533: start","job_status":"start","queue_duration_s":0.8189,"scheduling_latency_s":0.818952}1342gitlab # [ 267.438031] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.424Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d8146d5fabed8f38d5f6533","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d8146d5fabed8f38d5f6533: done: 0.041522 sec","job_status":"done","queue_duration_s":0.8189,"scheduling_latency_s":0.818952,"redis_calls":13,"redis_duration_s":0.004125,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001487,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002638,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028279,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.041522,"completed_at":"2026-08-20T05:52:20.423Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1343gitlab # [ 267.478272] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.427Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4c8a52fe5f335d2d48699141","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4c8a52fe5f335d2d48699141: start","job_status":"start","queue_duration_s":0.863822,"scheduling_latency_s":0.863871}1344gitlab # [ 267.491016] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.457Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4c8a52fe5f335d2d48699141","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4c8a52fe5f335d2d48699141: done: 0.030544 sec","job_status":"done","queue_duration_s":0.863822,"scheduling_latency_s":0.863871,"redis_calls":13,"redis_duration_s":0.003179,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001094,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002085,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019184,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030544,"completed_at":"2026-08-20T05:52:20.457Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1345gitlab # [ 267.531560] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.460Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a1034b55c8f1c25fe656c8ea","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a1034b55c8f1c25fe656c8ea: start","job_status":"start","queue_duration_s":0.896502,"scheduling_latency_s":0.896532}1346gitlab # [ 267.544425] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.483Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a1034b55c8f1c25fe656c8ea","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a1034b55c8f1c25fe656c8ea: done: 0.023257 sec","job_status":"done","queue_duration_s":0.896502,"scheduling_latency_s":0.896532,"redis_calls":13,"redis_duration_s":0.003202,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001077,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002125,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014461,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023257,"completed_at":"2026-08-20T05:52:20.483Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1347gitlab # [ 267.584101] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.485Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51c395a64d566d83206eb4ac","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51c395a64d566d83206eb4ac: start","job_status":"start","queue_duration_s":0.921805,"scheduling_latency_s":0.921829}1348gitlab # [ 267.596521] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.506Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51c395a64d566d83206eb4ac","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51c395a64d566d83206eb4ac: done: 0.020546 sec","job_status":"done","queue_duration_s":0.921805,"scheduling_latency_s":0.921829,"redis_calls":13,"redis_duration_s":0.002874,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000997,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001877,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012936,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020546,"completed_at":"2026-08-20T05:52:20.505Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1349gitlab # [ 267.637340] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.508Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c84401de62ebf8ec9bc6e2d2","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c84401de62ebf8ec9bc6e2d2: start","job_status":"start","queue_duration_s":0.944314,"scheduling_latency_s":0.944336}1350gitlab # [ 267.650012] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.527Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c84401de62ebf8ec9bc6e2d2","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c84401de62ebf8ec9bc6e2d2: done: 0.019267 sec","job_status":"done","queue_duration_s":0.944314,"scheduling_latency_s":0.944336,"redis_calls":13,"redis_duration_s":0.0029960000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000995,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002001,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0121,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019267,"completed_at":"2026-08-20T05:52:20.527Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1351gitlab # [ 267.689939] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.529Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"439889402057a8308eae11ac","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-439889402057a8308eae11ac: start","job_status":"start","queue_duration_s":0.965553,"scheduling_latency_s":0.965574}1352gitlab # [ 267.702270] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.547Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"439889402057a8308eae11ac","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-439889402057a8308eae11ac: done: 0.018772 sec","job_status":"done","queue_duration_s":0.965553,"scheduling_latency_s":0.965574,"redis_calls":13,"redis_duration_s":0.003006,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000978,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002028,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011714,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018772,"completed_at":"2026-08-20T05:52:20.547Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1353gitlab # [ 267.741901] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.550Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e9fe57ca5bc31e4d6514fe59","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e9fe57ca5bc31e4d6514fe59: start","job_status":"start","queue_duration_s":0.986318,"scheduling_latency_s":0.986339}1354gitlab # [ 267.754319] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.568Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e9fe57ca5bc31e4d6514fe59","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e9fe57ca5bc31e4d6514fe59: done: 0.018198 sec","job_status":"done","queue_duration_s":0.986318,"scheduling_latency_s":0.986339,"redis_calls":13,"redis_duration_s":0.002556,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00094,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001616,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011419,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018198,"completed_at":"2026-08-20T05:52:20.568Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1355gitlab # [ 267.794282] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.569Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"091b7be45f6643f051137bbd","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-091b7be45f6643f051137bbd: start","job_status":"start","queue_duration_s":1.006267,"scheduling_latency_s":1.006287}1356gitlab # [ 267.806875] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.588Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"091b7be45f6643f051137bbd","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-091b7be45f6643f051137bbd: done: 0.018442 sec","job_status":"done","queue_duration_s":1.006267,"scheduling_latency_s":1.006287,"redis_calls":13,"redis_duration_s":0.002667,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000967,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0017,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011566,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018442,"completed_at":"2026-08-20T05:52:20.588Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1357gitlab # [ 267.847057] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.590Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"233ba5451a08102c85c0f2b8","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-233ba5451a08102c85c0f2b8: start","job_status":"start","queue_duration_s":1.026464,"scheduling_latency_s":1.026486}1358gitlab # [ 267.859619] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.608Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"233ba5451a08102c85c0f2b8","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-233ba5451a08102c85c0f2b8: done: 0.018446 sec","job_status":"done","queue_duration_s":1.026464,"scheduling_latency_s":1.026486,"redis_calls":13,"redis_duration_s":0.002688,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000971,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001717,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011664,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018446,"completed_at":"2026-08-20T05:52:20.608Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1359gitlab # [ 267.899178] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.610Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa0878d994346b0d24989ebe","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa0878d994346b0d24989ebe: start","job_status":"start","queue_duration_s":1.046824,"scheduling_latency_s":1.046847}1360gitlab # [ 267.911808] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.629Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fa0878d994346b0d24989ebe","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fa0878d994346b0d24989ebe: done: 0.018704 sec","job_status":"done","queue_duration_s":1.046824,"scheduling_latency_s":1.046847,"redis_calls":13,"redis_duration_s":0.0027549999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001027,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001728,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011561,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018704,"completed_at":"2026-08-20T05:52:20.629Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1361gitlab # [ 267.951486] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.630Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d84ff1b4ef5e1034f45cd059","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d84ff1b4ef5e1034f45cd059: start","job_status":"start","queue_duration_s":1.067104,"scheduling_latency_s":1.067122}1362gitlab # [ 267.963873] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.649Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d84ff1b4ef5e1034f45cd059","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d84ff1b4ef5e1034f45cd059: done: 0.018703 sec","job_status":"done","queue_duration_s":1.067104,"scheduling_latency_s":1.067122,"redis_calls":13,"redis_duration_s":0.002895,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00189,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011479,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018703,"completed_at":"2026-08-20T05:52:20.649Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1363gitlab # [ 268.003384] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.651Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fac01a3e9edc1404450f47aa","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fac01a3e9edc1404450f47aa: start","job_status":"start","queue_duration_s":1.087415,"scheduling_latency_s":1.087438}1364gitlab # [ 268.016025] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.671Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fac01a3e9edc1404450f47aa","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fac01a3e9edc1404450f47aa: done: 0.019757 sec","job_status":"done","queue_duration_s":1.087415,"scheduling_latency_s":1.087438,"redis_calls":13,"redis_duration_s":0.0030830000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002027,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011927,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019757,"completed_at":"2026-08-20T05:52:20.670Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1365gitlab # [ 268.056216] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.672Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"955a0b6a2d3e6d68a3aa8cd6","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-955a0b6a2d3e6d68a3aa8cd6: start","job_status":"start","queue_duration_s":1.109164,"scheduling_latency_s":1.109188}1366gitlab # [ 268.068602] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.692Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"955a0b6a2d3e6d68a3aa8cd6","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-955a0b6a2d3e6d68a3aa8cd6: done: 0.019412 sec","job_status":"done","queue_duration_s":1.109164,"scheduling_latency_s":1.109188,"redis_calls":13,"redis_duration_s":0.0033699999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001063,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002307,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01169,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019412,"completed_at":"2026-08-20T05:52:20.692Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1367gitlab # [ 268.107616] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.694Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ac6b2caa4d0f472664eb10b","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ac6b2caa4d0f472664eb10b: start","job_status":"start","queue_duration_s":1.130333,"scheduling_latency_s":1.130352}1368gitlab # [ 268.120195] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.712Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ac6b2caa4d0f472664eb10b","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ac6b2caa4d0f472664eb10b: done: 0.018363 sec","job_status":"done","queue_duration_s":1.130333,"scheduling_latency_s":1.130352,"redis_calls":13,"redis_duration_s":0.002711,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001036,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001675,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011449,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018363,"completed_at":"2026-08-20T05:52:20.712Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1369gitlab # [ 268.159401] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.714Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa78fdb9aecc27cccc27b2e6","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa78fdb9aecc27cccc27b2e6: start","job_status":"start","queue_duration_s":1.150892,"scheduling_latency_s":1.150912}1370gitlab # [ 268.171982] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.732Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa78fdb9aecc27cccc27b2e6","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa78fdb9aecc27cccc27b2e6: done: 0.018098 sec","job_status":"done","queue_duration_s":1.150892,"scheduling_latency_s":1.150912,"redis_calls":13,"redis_duration_s":0.00285,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001044,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001806,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011612,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018098,"completed_at":"2026-08-20T05:52:20.732Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1371gitlab # [ 268.211152] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.734Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"438f91fbf6b1474c3b5c1e7f","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-438f91fbf6b1474c3b5c1e7f: start","job_status":"start","queue_duration_s":1.170805,"scheduling_latency_s":1.170823}1372gitlab # [ 268.224922] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.752Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"438f91fbf6b1474c3b5c1e7f","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-438f91fbf6b1474c3b5c1e7f: done: 0.018503 sec","job_status":"done","queue_duration_s":1.170805,"scheduling_latency_s":1.170823,"redis_calls":13,"redis_duration_s":0.002933,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00099,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001943,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011682,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018503,"completed_at":"2026-08-20T05:52:20.752Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1373gitlab # [ 268.264097] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.754Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77a921a63a4888f4595e4b3d","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77a921a63a4888f4595e4b3d: start","job_status":"start","queue_duration_s":1.191128,"scheduling_latency_s":1.191146}1374gitlab # [ 268.276392] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.773Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77a921a63a4888f4595e4b3d","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77a921a63a4888f4595e4b3d: done: 0.018213 sec","job_status":"done","queue_duration_s":1.191128,"scheduling_latency_s":1.191146,"redis_calls":13,"redis_duration_s":0.002908,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001018,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00189,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011763,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018213,"completed_at":"2026-08-20T05:52:20.772Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1375gitlab # [ 268.316049] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.774Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"35f1b531811c3134468ceea1","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-35f1b531811c3134468ceea1: start","job_status":"start","queue_duration_s":1.211123,"scheduling_latency_s":1.211141}1376gitlab # [ 268.328494] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.792Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"35f1b531811c3134468ceea1","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-35f1b531811c3134468ceea1: done: 0.017311 sec","job_status":"done","queue_duration_s":1.211123,"scheduling_latency_s":1.211141,"redis_calls":13,"redis_duration_s":0.002733,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000903,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00183,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011132,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017311,"completed_at":"2026-08-20T05:52:20.792Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1377gitlab # [ 268.367528] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.793Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ffc6acff3a89dae42c9e97f1","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ffc6acff3a89dae42c9e97f1: start","job_status":"start","queue_duration_s":1.230179,"scheduling_latency_s":1.230197}1378gitlab # [ 268.380303] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.811Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ffc6acff3a89dae42c9e97f1","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ffc6acff3a89dae42c9e97f1: done: 0.017551 sec","job_status":"done","queue_duration_s":1.230179,"scheduling_latency_s":1.230197,"redis_calls":13,"redis_duration_s":0.0026810000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000944,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001737,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010969,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017551,"completed_at":"2026-08-20T05:52:20.811Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1379gitlab # [ 268.419378] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.813Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7c9269e5d7ddede771e6f069","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7c9269e5d7ddede771e6f069: start","job_status":"start","queue_duration_s":1.249291,"scheduling_latency_s":1.249308}1380gitlab # [ 268.433150] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.830Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7c9269e5d7ddede771e6f069","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7c9269e5d7ddede771e6f069: done: 0.017382 sec","job_status":"done","queue_duration_s":1.249291,"scheduling_latency_s":1.249308,"redis_calls":13,"redis_duration_s":0.002823,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000958,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001865,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010611,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017382,"completed_at":"2026-08-20T05:52:20.830Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1381gitlab # [ 268.472455] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.831Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a99586ea2306f8867ddc39ea","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a99586ea2306f8867ddc39ea: start","job_status":"start","queue_duration_s":1.268205,"scheduling_latency_s":1.268221}1382gitlab # [ 268.484822] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.849Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a99586ea2306f8867ddc39ea","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a99586ea2306f8867ddc39ea: done: 0.017821 sec","job_status":"done","queue_duration_s":1.268205,"scheduling_latency_s":1.268221,"redis_calls":13,"redis_duration_s":0.003216,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000984,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002232,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01091,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017821,"completed_at":"2026-08-20T05:52:20.849Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1383gitlab # [ 268.524374] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.851Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e5fd69ee39b8a5a014fa801","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e5fd69ee39b8a5a014fa801: start","job_status":"start","queue_duration_s":1.287586,"scheduling_latency_s":1.287604}1384gitlab # [ 268.536647] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.868Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e5fd69ee39b8a5a014fa801","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e5fd69ee39b8a5a014fa801: done: 0.0177 sec","job_status":"done","queue_duration_s":1.287586,"scheduling_latency_s":1.287604,"redis_calls":13,"redis_duration_s":0.0030610000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000985,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002076,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010817,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0177,"completed_at":"2026-08-20T05:52:20.868Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1385gitlab # [ 268.576040] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.870Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c320dc7a0036ed356fd2cf0e","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c320dc7a0036ed356fd2cf0e: start","job_status":"start","queue_duration_s":1.306936,"scheduling_latency_s":1.306953}1386gitlab # [ 268.588795] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.887Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c320dc7a0036ed356fd2cf0e","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c320dc7a0036ed356fd2cf0e: done: 0.016841 sec","job_status":"done","queue_duration_s":1.306936,"scheduling_latency_s":1.306953,"redis_calls":13,"redis_duration_s":0.002744,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000945,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001799,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01051,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016841,"completed_at":"2026-08-20T05:52:20.887Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1387gitlab # [ 268.628108] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.889Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e8aba7ac45aeee44948f9c2b","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e8aba7ac45aeee44948f9c2b: start","job_status":"start","queue_duration_s":1.32541,"scheduling_latency_s":1.325427}1388gitlab # [ 268.641884] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.906Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e8aba7ac45aeee44948f9c2b","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e8aba7ac45aeee44948f9c2b: done: 0.017266 sec","job_status":"done","queue_duration_s":1.32541,"scheduling_latency_s":1.325427,"redis_calls":13,"redis_duration_s":0.002823,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000951,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001872,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0108,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017266,"completed_at":"2026-08-20T05:52:20.906Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1389gitlab # [ 268.680709] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.908Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6a69de4a47d0d80e745b6ff3","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6a69de4a47d0d80e745b6ff3: start","job_status":"start","queue_duration_s":1.344607,"scheduling_latency_s":1.344629}1390gitlab # [ 268.693004] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:52:20.925Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6a69de4a47d0d80e745b6ff3","created_at":"2026-08-20T05:52:19.476Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-4d4ae90fe9724fcb","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a750d5d5a5e47e5265cf08723d00f8b2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:52:19.563Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6a69de4a47d0d80e745b6ff3: done: 0.01765 sec","job_status":"done","queue_duration_s":1.344607,"scheduling_latency_s":1.344629,"redis_calls":13,"redis_duration_s":0.002842,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000975,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001867,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011179,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01765,"completed_at":"2026-08-20T05:52:20.925Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1391gitlab # [ 306.614188] setup-gitlab-start[3146]: W, [2026-08-20T05:53:00.529169 #3146] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1392gitlab # [ 309.109865] redis[795]: 10 changes in 300 seconds. Saving...1393gitlab # [ 309.110397] redis[795]: Background saving started by pid 33871394gitlab # [ 309.119479] redis[3387]: BGSAVE done, 426 keys saved, 0 keys skipped, 113610 bytes written.1395gitlab # [ 309.124869] redis[3387]: DB saved on disk1396gitlab # [ 309.127147] redis[3387]: Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB1397gitlab # [ 309.210992] redis[795]: Background saving terminated with success1398gitlab # [ 310.779149] postgres[864]: [864] LOG: checkpoint starting: time1399gitlab # [ 312.113551] gitaly[925]: time="2026-08-20T05:53:06.028Z" level=info msg="burden monitor stats" pid=9251400gitlab # [ 312.708951] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:06.623Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"ad4693c1b30623712bccaa23","created_at":"2026-08-20T05:53:06.590Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"563f50ed0aabc17151ea8091e94a7525","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:06.614Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-ad4693c1b30623712bccaa23: start","job_status":"start","queue_duration_s":0.008168,"scheduling_latency_s":0.008235}1401gitlab # [ 313.342289] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:07.257Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"ad4693c1b30623712bccaa23","created_at":"2026-08-20T05:53:06.590Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"563f50ed0aabc17151ea8091e94a7525","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:06.614Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-ad4693c1b30623712bccaa23: done: 0.634526 sec","job_status":"done","queue_duration_s":0.008168,"scheduling_latency_s":0.008235,"redis_calls":18,"redis_duration_s":0.136907,"redis_read_bytes":1032,"redis_write_bytes":1752,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.035561,"redis_feature_flag_read_bytes":1024,"redis_feature_flag_write_bytes":513,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.082509,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.018837,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.137,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.137,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.068576,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.12574252,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.634526,"completed_at":"2026-08-20T05:53:07.257Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.136382,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1402gitlab # [ 313.465330] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:07.381Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"fb3bd0d011b18826bc52d39e","created_at":"2026-08-20T05:53:06.678Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a78fa1a39a90f661dc70a1d0385419a0","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:06.694Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-fb3bd0d011b18826bc52d39e: start","job_status":"start","queue_duration_s":0.686345,"scheduling_latency_s":0.68641}1403gitlab # [ 313.913056] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:07.827Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"fb3bd0d011b18826bc52d39e","created_at":"2026-08-20T05:53:06.678Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a78fa1a39a90f661dc70a1d0385419a0","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:06.694Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-fb3bd0d011b18826bc52d39e: done: 0.44626 sec","job_status":"done","queue_duration_s":0.686345,"scheduling_latency_s":0.68641,"redis_calls":7,"redis_duration_s":0.042713999999999995,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.034813,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.007901,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.04,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.04,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041537,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.44626,"completed_at":"2026-08-20T05:53:07.827Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.061744,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404gitlab # [ 313.993891] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:07.840Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"e8254065e4ec6a98f41ee09b","created_at":"2026-08-20T05:53:06.727Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"19c1b2f1b677454a59eb8f8c7325cfc0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:06.741Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-e8254065e4ec6a98f41ee09b: start","job_status":"start","queue_duration_s":1.098383,"scheduling_latency_s":1.09845}1405gitlab # [ 314.035608] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:07.950Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"e8254065e4ec6a98f41ee09b","created_at":"2026-08-20T05:53:06.727Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"19c1b2f1b677454a59eb8f8c7325cfc0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:06.741Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-e8254065e4ec6a98f41ee09b: done: 0.110492 sec","job_status":"done","queue_duration_s":1.098383,"scheduling_latency_s":1.09845,"redis_calls":8,"redis_duration_s":0.0034890000000000003,"redis_read_bytes":133,"redis_write_bytes":846,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000453,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":70,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002223,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000813,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030974,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.110492,"completed_at":"2026-08-20T05:53:07.950Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1406gitlab # [ 314.096932] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:08.012Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"7e2e8721f9a64bd90853aaa3","created_at":"2026-08-20T05:53:06.812Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0ec46e90efb729cba7cf2446688ffbcb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T05:53:06.823Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-7e2e8721f9a64bd90853aaa3: start","job_status":"start","queue_duration_s":1.189111,"scheduling_latency_s":1.189173}1407gitlab # [ 314.269623] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:08.185Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1408gitlab # [ 314.352800] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:08.267Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"7e2e8721f9a64bd90853aaa3","created_at":"2026-08-20T05:53:06.812Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0ec46e90efb729cba7cf2446688ffbcb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T05:53:06.823Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-7e2e8721f9a64bd90853aaa3: done: 0.25539 sec","job_status":"done","queue_duration_s":1.189111,"scheduling_latency_s":1.189173,"redis_calls":7,"redis_duration_s":0.042554999999999996,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.034947,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.007608,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027933,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.25539,"completed_at":"2026-08-20T05:53:08.267Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1409gitlab # [ 314.433705] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:08.311Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"1d4e5650280552bc28e9e80e","created_at":"2026-08-20T05:53:06.856Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"42d18b7f6a976c1643e2f76b1ded2101","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:06.882Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-1d4e5650280552bc28e9e80e: start","job_status":"start","queue_duration_s":1.42889,"scheduling_latency_s":1.428952}1410gitlab # [ 314.806706] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:08.721Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"1d4e5650280552bc28e9e80e","created_at":"2026-08-20T05:53:06.856Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"42d18b7f6a976c1643e2f76b1ded2101","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:06.882Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-1d4e5650280552bc28e9e80e: done: 0.410067 sec","job_status":"done","queue_duration_s":1.42889,"scheduling_latency_s":1.428952,"redis_calls":9,"redis_duration_s":0.024895,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.01403,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.010865,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.045,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.045,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.075954,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00438832,"exclusive_lock_hold_duration_s":0.21833256,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.410067,"completed_at":"2026-08-20T05:53:08.721Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.194432,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1411gitlab # [ 314.922297] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:08.837Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"b3d1cad9fed334279f251da1","created_at":"2026-08-20T05:53:06.969Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d8ced8394f20076aeeee7e75188afd93","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:06.995Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-b3d1cad9fed334279f251da1: start","job_status":"start","queue_duration_s":1.841698,"scheduling_latency_s":1.841762}1412gitlab # [ 315.039714] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:08.955Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"b3d1cad9fed334279f251da1","created_at":"2026-08-20T05:53:06.969Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d8ced8394f20076aeeee7e75188afd93","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:06.995Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-b3d1cad9fed334279f251da1: done: 0.117931 sec","job_status":"done","queue_duration_s":1.841698,"scheduling_latency_s":1.841762,"redis_calls":7,"redis_duration_s":0.010834,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.007991,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002843,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032982,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.117931,"completed_at":"2026-08-20T05:53:08.954Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003885,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1413gitlab # [ 315.129020] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:09.001Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"0fcde9ba48667b8f2e0d953f","created_at":"2026-08-20T05:53:07.024Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"674b0be5b4fdaeaefb2bd36bdb8eed90","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:07.039Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-0fcde9ba48667b8f2e0d953f: start","job_status":"start","queue_duration_s":1.961046,"scheduling_latency_s":1.961095}1414gitlab # [ 315.197249] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:09.112Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"0fcde9ba48667b8f2e0d953f","created_at":"2026-08-20T05:53:07.024Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"674b0be5b4fdaeaefb2bd36bdb8eed90","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:07.039Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-0fcde9ba48667b8f2e0d953f: done: 0.111552 sec","job_status":"done","queue_duration_s":1.961046,"scheduling_latency_s":1.961095,"redis_calls":7,"redis_duration_s":0.017461,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.013655,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003806,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.05,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.05,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022994,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.111552,"completed_at":"2026-08-20T05:53:09.112Z","load_balancing_strategy":"primary","db_duration_s":0.05025,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1415gitlab # [ 315.275218] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:09.130Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"fdd6a09ecb90781748a20e91","created_at":"2026-08-20T05:53:07.109Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f51c199fd313948ac7573e79d12648f9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:07.129Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-fdd6a09ecb90781748a20e91: start","job_status":"start","queue_duration_s":2.000789,"scheduling_latency_s":2.000854}1416gitlab # [ 315.449454] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:09.364Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"fdd6a09ecb90781748a20e91","created_at":"2026-08-20T05:53:07.109Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f51c199fd313948ac7573e79d12648f9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:07.129Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-fdd6a09ecb90781748a20e91: done: 0.233909 sec","job_status":"done","queue_duration_s":2.000789,"scheduling_latency_s":2.000854,"redis_calls":9,"redis_duration_s":0.0276,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.017938,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.009662,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.08,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.08,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.064792,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00252484,"exclusive_lock_hold_duration_s":0.06767894,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.233909,"completed_at":"2026-08-20T05:53:09.364Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0969,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1417gitlab # [ 315.537119] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:09.380Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"f53e3c0f25c2eaaa30fcb009","created_at":"2026-08-20T05:53:07.170Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9cf94420cbb1af432cf4eb3a63278127","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:07.189Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-f53e3c0f25c2eaaa30fcb009: start","job_status":"start","queue_duration_s":2.19057,"scheduling_latency_s":2.19064}1418gitlab # [ 315.570640] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:09.486Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1419gitlab # [ 315.608375] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:09.524Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"f53e3c0f25c2eaaa30fcb009","created_at":"2026-08-20T05:53:07.170Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9cf94420cbb1af432cf4eb3a63278127","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:07.189Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-f53e3c0f25c2eaaa30fcb009: done: 0.143605 sec","job_status":"done","queue_duration_s":2.19057,"scheduling_latency_s":2.19064,"redis_calls":7,"redis_duration_s":0.045671,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.011075,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.034596,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025728,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.143605,"completed_at":"2026-08-20T05:53:09.523Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1420gitlab # [ 315.668448] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:09.542Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"8239ccde145e549c154d8bb8","created_at":"2026-08-20T05:53:07.228Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d3cf8e0749d1099970dba8e59501ffd8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:07.241Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-8239ccde145e549c154d8bb8: start","job_status":"start","queue_duration_s":2.301061,"scheduling_latency_s":2.30113}1421gitlab # [ 315.690186] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:09.606Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1422gitlab # [ 315.725778] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:09.641Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"8239ccde145e549c154d8bb8","created_at":"2026-08-20T05:53:07.228Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d3cf8e0749d1099970dba8e59501ffd8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:07.241Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-8239ccde145e549c154d8bb8: done: 0.099144 sec","job_status":"done","queue_duration_s":2.301061,"scheduling_latency_s":2.30113,"redis_calls":7,"redis_duration_s":0.020058,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.013009,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.007049,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026279,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.099144,"completed_at":"2026-08-20T05:53:09.641Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1423gitlab # [ 315.789886] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:09.706Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"79a239d2233f1e739c646fb4","created_at":"2026-08-20T05:53:07.375Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"db81a7fc2a6b1396a0e5ef097d506f05","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:07.428Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-79a239d2233f1e739c646fb4: start","job_status":"start","queue_duration_s":2.277809,"scheduling_latency_s":2.277848}1424gitlab # [ 316.317446] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:10.231Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"79a239d2233f1e739c646fb4","created_at":"2026-08-20T05:53:07.375Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"db81a7fc2a6b1396a0e5ef097d506f05","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:07.428Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-79a239d2233f1e739c646fb4: done: 0.52542 sec","job_status":"done","queue_duration_s":2.277809,"scheduling_latency_s":2.277848,"redis_calls":9,"redis_duration_s":0.004504,"redis_read_bytes":7,"redis_write_bytes":987,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002451,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002053,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":129,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":129,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.063,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.063,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.419945,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0011383,"exclusive_lock_hold_duration_s":0.46112634,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.52542,"completed_at":"2026-08-20T05:53:10.231Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.103851,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1425gitlab # [ 316.413462] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:10.235Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"acef1ef8890c517e07c98bbd","created_at":"2026-08-20T05:53:07.478Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a8ebc90e52f37c96fedbbe2522a06015","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:07.489Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-acef1ef8890c517e07c98bbd: start","job_status":"start","queue_duration_s":2.745678,"scheduling_latency_s":2.745731}1426gitlab # [ 316.687745] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:10.603Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"acef1ef8890c517e07c98bbd","created_at":"2026-08-20T05:53:07.478Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a8ebc90e52f37c96fedbbe2522a06015","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:07.489Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-acef1ef8890c517e07c98bbd: done: 0.368199 sec","job_status":"done","queue_duration_s":2.745678,"scheduling_latency_s":2.745731,"redis_calls":562,"redis_duration_s":0.08396,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00153,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.08243,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.319758,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.368199,"completed_at":"2026-08-20T05:53:10.603Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1427gitlab # [ 316.781314] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:10.605Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"7effa15dea3ed017869879b4","created_at":"2026-08-20T05:53:07.538Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"61f4a8742c707691e6c2ae2465e1b378","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T05:53:07.566Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-7effa15dea3ed017869879b4: start","job_status":"start","queue_duration_s":3.038979,"scheduling_latency_s":3.03901}1428gitlab # [ 316.801303] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:10.614Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1429gitlab # [ 316.806265] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:10.621Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"7effa15dea3ed017869879b4","created_at":"2026-08-20T05:53:07.538Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"61f4a8742c707691e6c2ae2465e1b378","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T05:53:07.566Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-7effa15dea3ed017869879b4: done: 0.016056 sec","job_status":"done","queue_duration_s":3.038979,"scheduling_latency_s":3.03901,"redis_calls":7,"redis_duration_s":0.00145,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001044,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000406,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009814,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016056,"completed_at":"2026-08-20T05:53:10.621Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1430gitlab # [ 316.860502] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:10.622Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"9f9cfc00287c537f07d00650","created_at":"2026-08-20T05:53:07.625Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cec11cbb008d5970e6c142cb146b281c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:07.636Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-9f9cfc00287c537f07d00650: start","job_status":"start","queue_duration_s":2.985963,"scheduling_latency_s":2.98599}1431gitlab # [ 316.878430] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:10.655Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"9f9cfc00287c537f07d00650","created_at":"2026-08-20T05:53:07.625Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cec11cbb008d5970e6c142cb146b281c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:07.636Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-9f9cfc00287c537f07d00650: done: 0.032923 sec","job_status":"done","queue_duration_s":2.985963,"scheduling_latency_s":2.98599,"redis_calls":14,"redis_duration_s":0.003688,"redis_read_bytes":16,"redis_write_bytes":4030,"redis_queues_calls":2,"redis_queues_duration_s":0.000406,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.00242,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000862,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024248,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032923,"completed_at":"2026-08-20T05:53:10.655Z","load_balancing_strategy":"primary","db_duration_s":0.001708,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1432gitlab # [ 316.924710] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:10.657Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","jid":"15029f572c9c92d781376a87","created_at":"2026-08-20T05:53:07.689Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2cb4c2d6e8ac670e2cac4a4fe1eeabdb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:805014656d48c4962f83ad00758ac8cfab4de244cfbd1d771454e66bd9018911","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:07.968Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker JID-15029f572c9c92d781376a87: start","job_status":"start","queue_duration_s":2.689024,"scheduling_latency_s":2.68905}1433gitlab # [ 316.938601] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:10.771Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","jid":"15029f572c9c92d781376a87","created_at":"2026-08-20T05:53:07.689Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2cb4c2d6e8ac670e2cac4a4fe1eeabdb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:805014656d48c4962f83ad00758ac8cfab4de244cfbd1d771454e66bd9018911","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:07.968Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker JID-15029f572c9c92d781376a87: done: 0.114416 sec","job_status":"done","queue_duration_s":2.689024,"scheduling_latency_s":2.68905,"redis_calls":20,"redis_duration_s":0.00586,"redis_read_bytes":20,"redis_write_bytes":3247,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002425,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1346,"redis_queues_calls":2,"redis_queues_duration_s":0.00057,"redis_queues_read_bytes":3,"redis_queues_write_bytes":817,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001956,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":734,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000909,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":350,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.101883,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00040332,"duration_s":0.114416,"completed_at":"2026-08-20T05:53:10.771Z","load_balancing_strategy":"primary","db_duration_s":0.002271,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1434gitlab # [ 316.981768] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:10.773Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"8e774aa67e83165b5ed1cc61","created_at":"2026-08-20T05:53:08.039Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0a472a8cd0ea87b10af593b8fab530e5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:08.048Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-8e774aa67e83165b5ed1cc61: start","job_status":"start","queue_duration_s":2.725585,"scheduling_latency_s":2.725608}1435gitlab # [ 316.996352] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:10.783Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1436gitlab # [ 316.999466] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:10.791Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"8e774aa67e83165b5ed1cc61","created_at":"2026-08-20T05:53:08.039Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0a472a8cd0ea87b10af593b8fab530e5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:08.048Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-8e774aa67e83165b5ed1cc61: done: 0.017277 sec","job_status":"done","queue_duration_s":2.725585,"scheduling_latency_s":2.725608,"redis_calls":7,"redis_duration_s":0.00191,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001346,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000564,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010753,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017277,"completed_at":"2026-08-20T05:53:10.791Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1437gitlab # [ 317.040347] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:10.792Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"b3a63794ee15fd17faa296ad","created_at":"2026-08-20T05:53:08.072Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8cd7dd2e6c8e8f770158db59c003509e","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:08.083Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-b3a63794ee15fd17faa296ad: start","job_status":"start","queue_duration_s":2.709351,"scheduling_latency_s":2.709374}1438gitlab # [ 317.054629] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:10.814Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"b3a63794ee15fd17faa296ad","created_at":"2026-08-20T05:53:08.072Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8cd7dd2e6c8e8f770158db59c003509e","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:08.083Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-b3a63794ee15fd17faa296ad: done: 0.021302 sec","job_status":"done","queue_duration_s":2.709351,"scheduling_latency_s":2.709374,"redis_calls":9,"redis_duration_s":0.002567,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001352,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001215,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013555,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00068066,"exclusive_lock_hold_duration_s":0.00474014,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.021302,"completed_at":"2026-08-20T05:53:10.814Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002264,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1439gitlab # [ 317.097218] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:10.815Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"d04f25af108f0b372f76d5cf","created_at":"2026-08-20T05:53:08.108Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f48606b1c9169aa9539da351d71a5e57","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:08.117Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-d04f25af108f0b372f76d5cf: start","job_status":"start","queue_duration_s":2.697832,"scheduling_latency_s":2.697851}1440gitlab # [ 317.110907] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:10.836Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"d04f25af108f0b372f76d5cf","created_at":"2026-08-20T05:53:08.108Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f48606b1c9169aa9539da351d71a5e57","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:08.117Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-d04f25af108f0b372f76d5cf: done: 0.020231 sec","job_status":"done","queue_duration_s":2.697832,"scheduling_latency_s":2.697851,"redis_calls":9,"redis_duration_s":0.0022570000000000003,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001244,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001013,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013225,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0005779,"exclusive_lock_hold_duration_s":0.00374818,"duration_s":0.020231,"completed_at":"2026-08-20T05:53:10.835Z","load_balancing_strategy":"primary","db_duration_s":0.00117,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1441gitlab # [ 317.151179] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:10.837Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"5bca80e7899c43903701d91b","created_at":"2026-08-20T05:53:08.145Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:08.171Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-5bca80e7899c43903701d91b: start","job_status":"start","queue_duration_s":2.66615,"scheduling_latency_s":2.66617}1442gitlab # [ 317.164888] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:10.945Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"5bca80e7899c43903701d91b","created_at":"2026-08-20T05:53:08.145Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:08.171Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-5bca80e7899c43903701d91b: done: 0.108065 sec","job_status":"done","queue_duration_s":2.66615,"scheduling_latency_s":2.66617,"redis_calls":60,"redis_duration_s":0.01627,"redis_read_bytes":108,"redis_write_bytes":41009,"redis_queues_calls":2,"redis_queues_duration_s":0.00081,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37385,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.014697,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000763,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.092227,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.108065,"completed_at":"2026-08-20T05:53:10.945Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1443gitlab # [ 317.205648] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:10.947Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PipelineScheduleWorker","jid":"f875024dc155bc7c6b0c91d6","created_at":"2026-08-20T05:53:08.213Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ff9cb75db5db2992087d47858cfd1cea","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f6baa6e6d21754c4b13358fe49f8c31a08729a9dd276fb680a810caf1bc7fab5","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:08.273Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineScheduleWorker JID-f875024dc155bc7c6b0c91d6: start","job_status":"start","queue_duration_s":2.67401,"scheduling_latency_s":2.674035}1444gitlab # [ 317.218866] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:10.993Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PipelineScheduleWorker","jid":"f875024dc155bc7c6b0c91d6","created_at":"2026-08-20T05:53:08.213Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ff9cb75db5db2992087d47858cfd1cea","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f6baa6e6d21754c4b13358fe49f8c31a08729a9dd276fb680a810caf1bc7fab5","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:08.273Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineScheduleWorker JID-f875024dc155bc7c6b0c91d6: done: 0.04573 sec","job_status":"done","queue_duration_s":2.67401,"scheduling_latency_s":2.674035,"redis_calls":12,"redis_duration_s":0.003722,"redis_read_bytes":11,"redis_write_bytes":1281,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000528,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001841,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":518,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001353,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":476,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024905,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00067342,"exclusive_lock_hold_duration_s":0.01996668,"duration_s":0.04573,"completed_at":"2026-08-20T05:53:10.993Z","load_balancing_strategy":"primary","db_duration_s":0.010026,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1445gitlab # [ 317.260827] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:10.995Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"aec94e27ed994f8c510a8af2","created_at":"2026-08-20T05:53:08.284Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"666d039d134dae1af03e8aa35d588109","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:08.298Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-aec94e27ed994f8c510a8af2: start","job_status":"start","queue_duration_s":2.696003,"scheduling_latency_s":2.696025}1446gitlab # [ 317.275721] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.011Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"aec94e27ed994f8c510a8af2","created_at":"2026-08-20T05:53:08.284Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"666d039d134dae1af03e8aa35d588109","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:08.298Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-aec94e27ed994f8c510a8af2: done: 0.016894 sec","job_status":"done","queue_duration_s":2.696003,"scheduling_latency_s":2.696025,"redis_calls":7,"redis_duration_s":0.0026810000000000002,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002148,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000533,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010663,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016894,"completed_at":"2026-08-20T05:53:11.011Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1447gitlab # [ 317.318908] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.013Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"aa6a3393dd46de9d78d1627a","created_at":"2026-08-20T05:53:08.309Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"502a23174caed44922b716d995625ab3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:08.322Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-aa6a3393dd46de9d78d1627a: start","job_status":"start","queue_duration_s":2.690681,"scheduling_latency_s":2.690702}1448gitlab # [ 317.333462] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.023Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1449gitlab # [ 317.336837] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.029Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"aa6a3393dd46de9d78d1627a","created_at":"2026-08-20T05:53:08.309Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"502a23174caed44922b716d995625ab3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:08.322Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-aa6a3393dd46de9d78d1627a: done: 0.015885 sec","job_status":"done","queue_duration_s":2.690681,"scheduling_latency_s":2.690702,"redis_calls":7,"redis_duration_s":0.001756,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001276,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00048,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009998,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015885,"completed_at":"2026-08-20T05:53:11.029Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1450gitlab # [ 317.377900] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.031Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"27cf5c2b6890574beec260c8","created_at":"2026-08-20T05:53:08.331Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1590078d71b71dc19b7f07cd0add04af","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T05:53:08.341Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-27cf5c2b6890574beec260c8: start","job_status":"start","queue_duration_s":2.68917,"scheduling_latency_s":2.68919}1451gitlab # [ 317.391073] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.061Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"27cf5c2b6890574beec260c8","created_at":"2026-08-20T05:53:08.331Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1590078d71b71dc19b7f07cd0add04af","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T05:53:08.341Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-27cf5c2b6890574beec260c8: done: 0.03031 sec","job_status":"done","queue_duration_s":2.68917,"scheduling_latency_s":2.68919,"redis_calls":7,"redis_duration_s":0.002346,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001684,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000662,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02094,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03031,"completed_at":"2026-08-20T05:53:11.061Z","load_balancing_strategy":"primary","db_duration_s":0.002049,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1452gitlab # [ 317.430398] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.063Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"23442f23314706ef853dcf11","created_at":"2026-08-20T05:53:10.636Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-3e91e87309d046bc","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cec11cbb008d5970e6c142cb146b281c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.648Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-23442f23314706ef853dcf11: start","job_status":"start","queue_duration_s":0.415248,"scheduling_latency_s":0.415272}1453gitlab # [ 317.442513] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.078Z","message":"No existing merge request to be cleaned up."}1454gitlab # [ 317.444160] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.092Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"23442f23314706ef853dcf11","created_at":"2026-08-20T05:53:10.636Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-3e91e87309d046bc","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cec11cbb008d5970e6c142cb146b281c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.648Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-23442f23314706ef853dcf11: done: 0.02895 sec","job_status":"done","queue_duration_s":0.415248,"scheduling_latency_s":0.415272,"redis_calls":10,"redis_duration_s":0.00328,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001208,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002072,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020473,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02895,"completed_at":"2026-08-20T05:53:11.092Z","load_balancing_strategy":"primary","db_duration_s":0.002418,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1455gitlab # [ 317.482727] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.094Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"43884d60ddfb979372c02e2a","created_at":"2026-08-20T05:53:10.636Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-3e91e87309d046bc","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cec11cbb008d5970e6c142cb146b281c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.648Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-43884d60ddfb979372c02e2a: start","job_status":"start","queue_duration_s":0.446084,"scheduling_latency_s":0.44611}1456gitlab # [ 317.495160] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.111Z","message":"No existing merge request to be cleaned up."}1457gitlab # [ 317.496899] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.125Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"43884d60ddfb979372c02e2a","created_at":"2026-08-20T05:53:10.636Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-3e91e87309d046bc","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cec11cbb008d5970e6c142cb146b281c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.648Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-43884d60ddfb979372c02e2a: done: 0.030653 sec","job_status":"done","queue_duration_s":0.446084,"scheduling_latency_s":0.44611,"redis_calls":10,"redis_duration_s":0.00311,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001284,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001826,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021751,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030653,"completed_at":"2026-08-20T05:53:11.125Z","load_balancing_strategy":"primary","db_duration_s":0.002201,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1458gitlab # [ 317.536536] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.127Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5023b88c37e87e021aa8ba6b","created_at":"2026-08-20T05:53:10.636Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-3e91e87309d046bc","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cec11cbb008d5970e6c142cb146b281c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.648Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5023b88c37e87e021aa8ba6b: start","job_status":"start","queue_duration_s":0.478738,"scheduling_latency_s":0.478763}1459gitlab # [ 317.548790] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.145Z","message":"No existing merge request to be cleaned up."}1460gitlab # [ 317.550440] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.165Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5023b88c37e87e021aa8ba6b","created_at":"2026-08-20T05:53:10.636Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-3e91e87309d046bc","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cec11cbb008d5970e6c142cb146b281c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.648Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5023b88c37e87e021aa8ba6b: done: 0.038136 sec","job_status":"done","queue_duration_s":0.478738,"scheduling_latency_s":0.478763,"redis_calls":10,"redis_duration_s":0.0034070000000000003,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001572,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001835,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027321,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038136,"completed_at":"2026-08-20T05:53:11.165Z","load_balancing_strategy":"primary","db_duration_s":0.002597,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1461gitlab # [ 317.588826] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.167Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"baa6c848b2735ad8e41273cd","created_at":"2026-08-20T05:53:10.636Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-3e91e87309d046bc","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cec11cbb008d5970e6c142cb146b281c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.648Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-baa6c848b2735ad8e41273cd: start","job_status":"start","queue_duration_s":0.519154,"scheduling_latency_s":0.519182}1462gitlab # [ 317.601120] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.186Z","message":"No existing merge request to be cleaned up."}1463gitlab # [ 317.602779] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.203Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"baa6c848b2735ad8e41273cd","created_at":"2026-08-20T05:53:10.636Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-3e91e87309d046bc","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"cec11cbb008d5970e6c142cb146b281c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.648Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-baa6c848b2735ad8e41273cd: done: 0.035554 sec","job_status":"done","queue_duration_s":0.519154,"scheduling_latency_s":0.519182,"redis_calls":10,"redis_duration_s":0.0034739999999999997,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001466,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002008,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024804,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.035554,"completed_at":"2026-08-20T05:53:11.203Z","load_balancing_strategy":"primary","db_duration_s":0.003052,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1464gitlab # [ 317.641552] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.206Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Projects::RefreshBuildArtifactsSizeStatisticsWorker","args":[],"jid":"531043adbf1751963b5fb366","created_at":"2026-08-20T05:53:10.681Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-78b754b4adf248bd","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","correlation_id":"2cb4c2d6e8ac670e2cac4a4fe1eeabdb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.761Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::RefreshBuildArtifactsSizeStatisticsWorker JID-531043adbf1751963b5fb366: start","job_status":"start","queue_duration_s":0.444841,"scheduling_latency_s":0.444888}1465gitlab # [ 317.654535] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.293Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Projects::RefreshBuildArtifactsSizeStatisticsWorker","args":[],"jid":"531043adbf1751963b5fb366","created_at":"2026-08-20T05:53:10.681Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-78b754b4adf248bd","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Projects::ScheduleRefreshBuildArtifactsSizeStatisticsWorker","correlation_id":"2cb4c2d6e8ac670e2cac4a4fe1eeabdb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.761Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::RefreshBuildArtifactsSizeStatisticsWorker JID-531043adbf1751963b5fb366: done: 0.086568 sec","job_status":"done","queue_duration_s":0.444841,"scheduling_latency_s":0.444888,"redis_calls":13,"redis_duration_s":0.004936,"redis_read_bytes":12,"redis_write_bytes":1665,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000638,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":345,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001792,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":519,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002506,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":801,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.015,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.015,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.058333,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00069344,"duration_s":0.086568,"completed_at":"2026-08-20T05:53:11.293Z","load_balancing_strategy":"primary","db_duration_s":0.00975,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1466gitlab # [ 317.695393] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.296Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c5b5d7853fa1a7a650ce504","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c5b5d7853fa1a7a650ce504: start","job_status":"start","queue_duration_s":0.358616,"scheduling_latency_s":0.358651}1467gitlab # [ 317.708155] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.325Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c5b5d7853fa1a7a650ce504","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c5b5d7853fa1a7a650ce504: done: 0.029638 sec","job_status":"done","queue_duration_s":0.358616,"scheduling_latency_s":0.358651,"redis_calls":13,"redis_duration_s":0.003749,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001226,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002523,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019346,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029638,"completed_at":"2026-08-20T05:53:11.325Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1468gitlab # [ 317.748599] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.327Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c62ff5dd803cb43903e2b57a","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c62ff5dd803cb43903e2b57a: start","job_status":"start","queue_duration_s":0.390356,"scheduling_latency_s":0.390385}1469gitlab # [ 317.760946] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.353Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c62ff5dd803cb43903e2b57a","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c62ff5dd803cb43903e2b57a: done: 0.025575 sec","job_status":"done","queue_duration_s":0.390356,"scheduling_latency_s":0.390385,"redis_calls":13,"redis_duration_s":0.004532,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002218,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002314,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016951,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025575,"completed_at":"2026-08-20T05:53:11.353Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1470gitlab # [ 317.799860] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.355Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cdcbdb13d41cbb0ab4a116e9","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cdcbdb13d41cbb0ab4a116e9: start","job_status":"start","queue_duration_s":0.417799,"scheduling_latency_s":0.417826}1471gitlab # [ 317.812503] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.380Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cdcbdb13d41cbb0ab4a116e9","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cdcbdb13d41cbb0ab4a116e9: done: 0.025163 sec","job_status":"done","queue_duration_s":0.417799,"scheduling_latency_s":0.417826,"redis_calls":13,"redis_duration_s":0.003375,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001254,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002121,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01449,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025163,"completed_at":"2026-08-20T05:53:11.380Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1472gitlab # [ 317.852657] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.385Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"320ed1b2f011e87241aee13a","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-320ed1b2f011e87241aee13a: start","job_status":"start","queue_duration_s":0.448254,"scheduling_latency_s":0.448308}1473gitlab # [ 317.865638] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.428Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"320ed1b2f011e87241aee13a","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-320ed1b2f011e87241aee13a: done: 0.043237 sec","job_status":"done","queue_duration_s":0.448254,"scheduling_latency_s":0.448308,"redis_calls":13,"redis_duration_s":0.0047150000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001649,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003066,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030345,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.043237,"completed_at":"2026-08-20T05:53:11.428Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1474gitlab # [ 317.905874] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.431Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be010a81843e106d28deae51","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be010a81843e106d28deae51: start","job_status":"start","queue_duration_s":0.494375,"scheduling_latency_s":0.494419}1475gitlab # [ 317.918727] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.461Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be010a81843e106d28deae51","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be010a81843e106d28deae51: done: 0.030273 sec","job_status":"done","queue_duration_s":0.494375,"scheduling_latency_s":0.494419,"redis_calls":13,"redis_duration_s":0.0035800000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001203,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002377,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019835,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030273,"completed_at":"2026-08-20T05:53:11.461Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1476gitlab # [ 317.961397] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.464Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"614971e18d1b169f9c6798f8","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-614971e18d1b169f9c6798f8: start","job_status":"start","queue_duration_s":0.526692,"scheduling_latency_s":0.526726}1477gitlab # [ 317.974009] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.503Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"614971e18d1b169f9c6798f8","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-614971e18d1b169f9c6798f8: done: 0.039816 sec","job_status":"done","queue_duration_s":0.526692,"scheduling_latency_s":0.526726,"redis_calls":13,"redis_duration_s":0.005301,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001988,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003313,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028973,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.039816,"completed_at":"2026-08-20T05:53:11.503Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1478gitlab # [ 318.013641] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.507Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d60b04daf204461c83f5da3","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d60b04daf204461c83f5da3: start","job_status":"start","queue_duration_s":0.569936,"scheduling_latency_s":0.569991}1479gitlab # [ 318.026209] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.559Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d60b04daf204461c83f5da3","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d60b04daf204461c83f5da3: done: 0.051846 sec","job_status":"done","queue_duration_s":0.569936,"scheduling_latency_s":0.569991,"redis_calls":13,"redis_duration_s":0.004972,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001798,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003174,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026789,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.051846,"completed_at":"2026-08-20T05:53:11.558Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1480gitlab # [ 318.067907] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.564Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9656689f7fd99ab355a237ee","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9656689f7fd99ab355a237ee: start","job_status":"start","queue_duration_s":0.627085,"scheduling_latency_s":0.62714}1481gitlab # [ 318.080347] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.603Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9656689f7fd99ab355a237ee","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9656689f7fd99ab355a237ee: done: 0.038675 sec","job_status":"done","queue_duration_s":0.627085,"scheduling_latency_s":0.62714,"redis_calls":13,"redis_duration_s":0.0048649999999999995,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001634,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003231,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025393,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.038675,"completed_at":"2026-08-20T05:53:11.602Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1482gitlab # [ 318.119169] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.605Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d92f7a625fb000d23287e781","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d92f7a625fb000d23287e781: start","job_status":"start","queue_duration_s":0.66853,"scheduling_latency_s":0.668575}1483gitlab # [ 318.132787] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.636Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d92f7a625fb000d23287e781","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d92f7a625fb000d23287e781: done: 0.030336 sec","job_status":"done","queue_duration_s":0.66853,"scheduling_latency_s":0.668575,"redis_calls":13,"redis_duration_s":0.0037349999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001263,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002472,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019793,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030336,"completed_at":"2026-08-20T05:53:11.636Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1484gitlab # [ 318.171748] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.638Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"455c565761f5f61c86331e07","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-455c565761f5f61c86331e07: start","job_status":"start","queue_duration_s":0.701042,"scheduling_latency_s":0.701077}1485gitlab # [ 318.184175] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.662Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"455c565761f5f61c86331e07","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-455c565761f5f61c86331e07: done: 0.023673 sec","job_status":"done","queue_duration_s":0.701042,"scheduling_latency_s":0.701077,"redis_calls":13,"redis_duration_s":0.003464,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001177,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002287,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015057,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023673,"completed_at":"2026-08-20T05:53:11.661Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1486gitlab # [ 318.222464] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.664Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"870abbe7a7b2f23c85006d12","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-870abbe7a7b2f23c85006d12: start","job_status":"start","queue_duration_s":0.72701,"scheduling_latency_s":0.727042}1487gitlab # [ 318.235217] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.694Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"870abbe7a7b2f23c85006d12","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-870abbe7a7b2f23c85006d12: done: 0.029791 sec","job_status":"done","queue_duration_s":0.72701,"scheduling_latency_s":0.727042,"redis_calls":13,"redis_duration_s":0.003766,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001218,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002548,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019242,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029791,"completed_at":"2026-08-20T05:53:11.694Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1488gitlab # [ 318.274957] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.699Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a9f1c80f7feea651e31be90d","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a9f1c80f7feea651e31be90d: start","job_status":"start","queue_duration_s":0.761942,"scheduling_latency_s":0.761991}1489gitlab # [ 318.287718] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.740Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a9f1c80f7feea651e31be90d","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a9f1c80f7feea651e31be90d: done: 0.041396 sec","job_status":"done","queue_duration_s":0.761942,"scheduling_latency_s":0.761991,"redis_calls":13,"redis_duration_s":0.004507,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001491,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003016,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027976,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.041396,"completed_at":"2026-08-20T05:53:11.740Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1490gitlab # [ 318.327510] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.743Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ef29bf60b39aaf0f123a04a1","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ef29bf60b39aaf0f123a04a1: start","job_status":"start","queue_duration_s":0.806232,"scheduling_latency_s":0.806275}1491gitlab # [ 318.341368] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.782Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ef29bf60b39aaf0f123a04a1","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ef29bf60b39aaf0f123a04a1: done: 0.038558 sec","job_status":"done","queue_duration_s":0.806232,"scheduling_latency_s":0.806275,"redis_calls":13,"redis_duration_s":0.0046,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001566,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003034,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026472,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.038558,"completed_at":"2026-08-20T05:53:11.781Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1492gitlab # [ 318.380559] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.785Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47db4656e14a41ad0580f3da","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47db4656e14a41ad0580f3da: start","job_status":"start","queue_duration_s":0.848105,"scheduling_latency_s":0.848153}1493gitlab # [ 318.393478] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.828Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47db4656e14a41ad0580f3da","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47db4656e14a41ad0580f3da: done: 0.042911 sec","job_status":"done","queue_duration_s":0.848105,"scheduling_latency_s":0.848153,"redis_calls":13,"redis_duration_s":0.004483,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001497,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002986,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029184,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.042911,"completed_at":"2026-08-20T05:53:11.828Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1494gitlab # [ 318.432730] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.830Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d4c90f23fc283af11b1cd826","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d4c90f23fc283af11b1cd826: start","job_status":"start","queue_duration_s":0.893284,"scheduling_latency_s":0.89336}1495gitlab # [ 318.445322] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.881Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d4c90f23fc283af11b1cd826","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d4c90f23fc283af11b1cd826: done: 0.050982 sec","job_status":"done","queue_duration_s":0.893284,"scheduling_latency_s":0.89336,"redis_calls":13,"redis_duration_s":0.004113,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001407,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002706,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025902,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.050982,"completed_at":"2026-08-20T05:53:11.881Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1496gitlab # [ 318.484966] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.885Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"781785436653788bc8c42093","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-781785436653788bc8c42093: start","job_status":"start","queue_duration_s":0.947578,"scheduling_latency_s":0.947629}1497gitlab # [ 318.497439] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.921Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"781785436653788bc8c42093","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-781785436653788bc8c42093: done: 0.03669 sec","job_status":"done","queue_duration_s":0.947578,"scheduling_latency_s":0.947629,"redis_calls":13,"redis_duration_s":0.004018,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001754,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002264,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024633,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03669,"completed_at":"2026-08-20T05:53:11.921Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1498gitlab # [ 318.537627] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.923Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b6972438b3514e3751af75b7","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b6972438b3514e3751af75b7: start","job_status":"start","queue_duration_s":0.986536,"scheduling_latency_s":0.986575}1499gitlab # [ 318.550879] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.953Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b6972438b3514e3751af75b7","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b6972438b3514e3751af75b7: done: 0.029352 sec","job_status":"done","queue_duration_s":0.986536,"scheduling_latency_s":0.986575,"redis_calls":13,"redis_duration_s":0.002944,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001152,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001792,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019928,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029352,"completed_at":"2026-08-20T05:53:11.953Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1500gitlab # [ 318.590435] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.955Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c785e88697459b8aa32ab154","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c785e88697459b8aa32ab154: start","job_status":"start","queue_duration_s":1.017935,"scheduling_latency_s":1.017973}1501gitlab # [ 318.603030] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.981Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c785e88697459b8aa32ab154","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c785e88697459b8aa32ab154: done: 0.026375 sec","job_status":"done","queue_duration_s":1.017935,"scheduling_latency_s":1.017973,"redis_calls":13,"redis_duration_s":0.002493,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00095,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001543,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016265,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026375,"completed_at":"2026-08-20T05:53:11.981Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1502gitlab # [ 318.642121] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:11.984Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc040c541a83b34b4cd555d6","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc040c541a83b34b4cd555d6: start","job_status":"start","queue_duration_s":1.047461,"scheduling_latency_s":1.047497}1503gitlab # [ 318.654614] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.011Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc040c541a83b34b4cd555d6","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc040c541a83b34b4cd555d6: done: 0.026869 sec","job_status":"done","queue_duration_s":1.047461,"scheduling_latency_s":1.047497,"redis_calls":13,"redis_duration_s":0.004001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000971,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00303,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018224,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026869,"completed_at":"2026-08-20T05:53:12.011Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1504gitlab # [ 318.694088] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.013Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf46083f7b479fff5a3c95b1","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf46083f7b479fff5a3c95b1: start","job_status":"start","queue_duration_s":1.076233,"scheduling_latency_s":1.076268}1505gitlab # [ 318.706569] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.035Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf46083f7b479fff5a3c95b1","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf46083f7b479fff5a3c95b1: done: 0.022196 sec","job_status":"done","queue_duration_s":1.076233,"scheduling_latency_s":1.076268,"redis_calls":13,"redis_duration_s":0.001968,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000719,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001249,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0146,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022196,"completed_at":"2026-08-20T05:53:12.035Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1506gitlab # [ 318.746685] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.037Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a5828c9d6f255d79b5d2ae13","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a5828c9d6f255d79b5d2ae13: start","job_status":"start","queue_duration_s":1.099808,"scheduling_latency_s":1.099836}1507gitlab # [ 318.759324] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.055Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a5828c9d6f255d79b5d2ae13","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a5828c9d6f255d79b5d2ae13: done: 0.018272 sec","job_status":"done","queue_duration_s":1.099808,"scheduling_latency_s":1.099836,"redis_calls":13,"redis_duration_s":0.001562,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000566,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000996,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012513,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018272,"completed_at":"2026-08-20T05:53:12.055Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1508gitlab # [ 318.799138] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.056Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b140a879dd010badf8388b9","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b140a879dd010badf8388b9: start","job_status":"start","queue_duration_s":1.119536,"scheduling_latency_s":1.119562}1509gitlab # [ 318.811780] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.077Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b140a879dd010badf8388b9","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b140a879dd010badf8388b9: done: 0.020324 sec","job_status":"done","queue_duration_s":1.119536,"scheduling_latency_s":1.119562,"redis_calls":13,"redis_duration_s":0.001723,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000634,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001089,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011662,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020324,"completed_at":"2026-08-20T05:53:12.077Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1510gitlab # [ 318.851258] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.078Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7db6fcef8f16db5495cd108d","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7db6fcef8f16db5495cd108d: start","job_status":"start","queue_duration_s":1.141432,"scheduling_latency_s":1.141462}1511gitlab # [ 318.863783] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.099Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7db6fcef8f16db5495cd108d","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7db6fcef8f16db5495cd108d: done: 0.020635 sec","job_status":"done","queue_duration_s":1.141432,"scheduling_latency_s":1.141462,"redis_calls":13,"redis_duration_s":0.0028770000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000724,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002153,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013481,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020635,"completed_at":"2026-08-20T05:53:12.099Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1512gitlab # [ 318.903049] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.101Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0780321bf91d8a1bf9ebb9a","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0780321bf91d8a1bf9ebb9a: start","job_status":"start","queue_duration_s":1.163671,"scheduling_latency_s":1.163697}1513gitlab # [ 318.915639] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.120Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0780321bf91d8a1bf9ebb9a","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0780321bf91d8a1bf9ebb9a: done: 0.019861 sec","job_status":"done","queue_duration_s":1.163671,"scheduling_latency_s":1.163697,"redis_calls":13,"redis_duration_s":0.001955,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000774,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001181,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013424,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019861,"completed_at":"2026-08-20T05:53:12.120Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1514gitlab # [ 318.956447] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.122Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a9a22ed9722694d48eb8c8f6","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a9a22ed9722694d48eb8c8f6: start","job_status":"start","queue_duration_s":1.185013,"scheduling_latency_s":1.185038}1515gitlab # [ 318.968740] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.141Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a9a22ed9722694d48eb8c8f6","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a9a22ed9722694d48eb8c8f6: done: 0.019197 sec","job_status":"done","queue_duration_s":1.185013,"scheduling_latency_s":1.185038,"redis_calls":13,"redis_duration_s":0.0017460000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000641,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001105,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011792,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019197,"completed_at":"2026-08-20T05:53:12.141Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1516gitlab # [ 319.007902] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.148Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"65453183e50785f841c85f56","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-65453183e50785f841c85f56: start","job_status":"start","queue_duration_s":1.210856,"scheduling_latency_s":1.210885}1517gitlab # [ 319.020454] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.166Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"65453183e50785f841c85f56","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-65453183e50785f841c85f56: done: 0.018486 sec","job_status":"done","queue_duration_s":1.210856,"scheduling_latency_s":1.210885,"redis_calls":13,"redis_duration_s":0.0016259999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000622,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001004,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012439,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018486,"completed_at":"2026-08-20T05:53:12.166Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1518gitlab # [ 319.059623] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.168Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7044d14a4c50c12a29b190b2","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7044d14a4c50c12a29b190b2: start","job_status":"start","queue_duration_s":1.230666,"scheduling_latency_s":1.230693}1519gitlab # [ 319.072113] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.185Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7044d14a4c50c12a29b190b2","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7044d14a4c50c12a29b190b2: done: 0.017798 sec","job_status":"done","queue_duration_s":1.230666,"scheduling_latency_s":1.230693,"redis_calls":13,"redis_duration_s":0.0015639999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000589,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000975,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012041,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017798,"completed_at":"2026-08-20T05:53:12.185Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1520gitlab # [ 319.111207] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.187Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8aee63c109d53be3067bd873","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8aee63c109d53be3067bd873: start","job_status":"start","queue_duration_s":1.249809,"scheduling_latency_s":1.249835}1521gitlab # [ 319.123766] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.205Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8aee63c109d53be3067bd873","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8aee63c109d53be3067bd873: done: 0.018061 sec","job_status":"done","queue_duration_s":1.249809,"scheduling_latency_s":1.249835,"redis_calls":13,"redis_duration_s":0.0016150000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000582,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001033,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012215,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018061,"completed_at":"2026-08-20T05:53:12.205Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1522gitlab # [ 319.164352] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.206Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c5fb1fe261e7643dcf78ce6","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c5fb1fe261e7643dcf78ce6: start","job_status":"start","queue_duration_s":1.269243,"scheduling_latency_s":1.269269}1523gitlab # [ 319.176665] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.224Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c5fb1fe261e7643dcf78ce6","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c5fb1fe261e7643dcf78ce6: done: 0.017825 sec","job_status":"done","queue_duration_s":1.269243,"scheduling_latency_s":1.269269,"redis_calls":13,"redis_duration_s":0.0016319999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000592,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00104,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011017,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017825,"completed_at":"2026-08-20T05:53:12.224Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1524gitlab # [ 319.216188] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.227Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2321a5ae3d561a5210b39796","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2321a5ae3d561a5210b39796: start","job_status":"start","queue_duration_s":1.289631,"scheduling_latency_s":1.289658}1525gitlab # [ 319.228407] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.244Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2321a5ae3d561a5210b39796","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2321a5ae3d561a5210b39796: done: 0.018037 sec","job_status":"done","queue_duration_s":1.289631,"scheduling_latency_s":1.289658,"redis_calls":13,"redis_duration_s":0.0017200000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000666,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001054,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012303,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018037,"completed_at":"2026-08-20T05:53:12.244Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1526gitlab # [ 319.267374] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.246Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e90380baf30f8639b919521","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e90380baf30f8639b919521: start","job_status":"start","queue_duration_s":1.309012,"scheduling_latency_s":1.309036}1527gitlab # [ 319.279896] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.263Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e90380baf30f8639b919521","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e90380baf30f8639b919521: done: 0.017497 sec","job_status":"done","queue_duration_s":1.309012,"scheduling_latency_s":1.309036,"redis_calls":13,"redis_duration_s":0.0015630000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000568,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000995,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012036,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017497,"completed_at":"2026-08-20T05:53:12.263Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1528gitlab # [ 319.319587] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.265Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e498463cecfb4b4c29f9d4df","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e498463cecfb4b4c29f9d4df: start","job_status":"start","queue_duration_s":1.327893,"scheduling_latency_s":1.327916}1529gitlab # [ 319.332643] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.281Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e498463cecfb4b4c29f9d4df","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e498463cecfb4b4c29f9d4df: done: 0.016424 sec","job_status":"done","queue_duration_s":1.327893,"scheduling_latency_s":1.327916,"redis_calls":13,"redis_duration_s":0.001483,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000945,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011215,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016424,"completed_at":"2026-08-20T05:53:12.281Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1530gitlab # [ 319.372814] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.283Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1bb01728c36cfadb9f309c9a","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1bb01728c36cfadb9f309c9a: start","job_status":"start","queue_duration_s":1.345746,"scheduling_latency_s":1.345765}1531gitlab # [ 319.385340] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.299Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1bb01728c36cfadb9f309c9a","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1bb01728c36cfadb9f309c9a: done: 0.016136 sec","job_status":"done","queue_duration_s":1.345746,"scheduling_latency_s":1.345765,"redis_calls":13,"redis_duration_s":0.001464,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000923,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010444,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016136,"completed_at":"2026-08-20T05:53:12.299Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1532gitlab # [ 319.424462] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.300Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f6777b146864a07c981714a","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f6777b146864a07c981714a: start","job_status":"start","queue_duration_s":1.363025,"scheduling_latency_s":1.363042}1533gitlab # [ 319.436755] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.319Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f6777b146864a07c981714a","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f6777b146864a07c981714a: done: 0.019348 sec","job_status":"done","queue_duration_s":1.363025,"scheduling_latency_s":1.363042,"redis_calls":13,"redis_duration_s":0.001813,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000572,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001241,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010998,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019348,"completed_at":"2026-08-20T05:53:12.319Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1534gitlab # [ 319.476167] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.320Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b1a0b45544b1d457ecbbb83","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b1a0b45544b1d457ecbbb83: start","job_status":"start","queue_duration_s":1.383585,"scheduling_latency_s":1.383602}1535gitlab # [ 319.488428] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.337Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b1a0b45544b1d457ecbbb83","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b1a0b45544b1d457ecbbb83: done: 0.016596 sec","job_status":"done","queue_duration_s":1.383585,"scheduling_latency_s":1.383602,"redis_calls":13,"redis_duration_s":0.0016220000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000589,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001033,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011446,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016596,"completed_at":"2026-08-20T05:53:12.337Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1536gitlab # [ 319.527595] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.338Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"144d0374f512aa29ea17665b","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-144d0374f512aa29ea17665b: start","job_status":"start","queue_duration_s":1.401425,"scheduling_latency_s":1.401445}1537gitlab # [ 319.540201] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.365Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"144d0374f512aa29ea17665b","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-144d0374f512aa29ea17665b: done: 0.026662 sec","job_status":"done","queue_duration_s":1.401425,"scheduling_latency_s":1.401445,"redis_calls":13,"redis_duration_s":0.003113,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001079,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002034,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011269,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026662,"completed_at":"2026-08-20T05:53:12.365Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1538gitlab # [ 319.580729] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.367Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d53192b4bb4d5b2e3b50906","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d53192b4bb4d5b2e3b50906: start","job_status":"start","queue_duration_s":1.429708,"scheduling_latency_s":1.429727}1539gitlab # [ 319.593242] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.383Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d53192b4bb4d5b2e3b50906","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d53192b4bb4d5b2e3b50906: done: 0.016893 sec","job_status":"done","queue_duration_s":1.429708,"scheduling_latency_s":1.429727,"redis_calls":13,"redis_duration_s":0.0026709999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000951,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00172,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010494,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016893,"completed_at":"2026-08-20T05:53:12.383Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1540gitlab # [ 319.632721] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.385Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"723aee6e737262bf0b2a4687","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-723aee6e737262bf0b2a4687: start","job_status":"start","queue_duration_s":1.447975,"scheduling_latency_s":1.447991}1541gitlab # [ 319.644844] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.402Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"723aee6e737262bf0b2a4687","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-723aee6e737262bf0b2a4687: done: 0.016864 sec","job_status":"done","queue_duration_s":1.447975,"scheduling_latency_s":1.447991,"redis_calls":13,"redis_duration_s":0.003064,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000977,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002087,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010794,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016864,"completed_at":"2026-08-20T05:53:12.402Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1542gitlab # [ 319.684119] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.404Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01c0fe41bc34d28f3bc3f5c0","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01c0fe41bc34d28f3bc3f5c0: start","job_status":"start","queue_duration_s":1.466732,"scheduling_latency_s":1.46675}1543gitlab # [ 319.696406] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.420Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"01c0fe41bc34d28f3bc3f5c0","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-01c0fe41bc34d28f3bc3f5c0: done: 0.016366 sec","job_status":"done","queue_duration_s":1.466732,"scheduling_latency_s":1.46675,"redis_calls":13,"redis_duration_s":0.002843,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001001,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001842,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010244,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016366,"completed_at":"2026-08-20T05:53:12.420Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1544gitlab # [ 319.735610] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.422Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f5bc3525193f2109edf4439","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f5bc3525193f2109edf4439: start","job_status":"start","queue_duration_s":1.485109,"scheduling_latency_s":1.485126}1545gitlab # [ 319.748150] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.439Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f5bc3525193f2109edf4439","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f5bc3525193f2109edf4439: done: 0.017371 sec","job_status":"done","queue_duration_s":1.485109,"scheduling_latency_s":1.485126,"redis_calls":13,"redis_duration_s":0.003009,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000986,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002023,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010993,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017371,"completed_at":"2026-08-20T05:53:12.439Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1546gitlab # [ 319.789045] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.441Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0eea1dda3555dc8e071c9096","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0eea1dda3555dc8e071c9096: start","job_status":"start","queue_duration_s":1.503911,"scheduling_latency_s":1.50393}1547gitlab # [ 319.801757] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.458Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0eea1dda3555dc8e071c9096","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0eea1dda3555dc8e071c9096: done: 0.01689 sec","job_status":"done","queue_duration_s":1.503911,"scheduling_latency_s":1.50393,"redis_calls":13,"redis_duration_s":0.001854,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000701,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001153,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01153,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01689,"completed_at":"2026-08-20T05:53:12.458Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1548gitlab # [ 319.841850] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.459Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f2d0ea702f10d096f12e477","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f2d0ea702f10d096f12e477: start","job_status":"start","queue_duration_s":1.522082,"scheduling_latency_s":1.5221}1549gitlab # [ 319.854506] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.476Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f2d0ea702f10d096f12e477","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f2d0ea702f10d096f12e477: done: 0.016846 sec","job_status":"done","queue_duration_s":1.522082,"scheduling_latency_s":1.5221,"redis_calls":13,"redis_duration_s":0.001782,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00066,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001122,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010894,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016846,"completed_at":"2026-08-20T05:53:12.476Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1550gitlab # [ 319.894319] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.477Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4957e3a9981a0f92c97db6a1","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4957e3a9981a0f92c97db6a1: start","job_status":"start","queue_duration_s":1.540559,"scheduling_latency_s":1.540578}1551gitlab # [ 319.907061] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.494Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4957e3a9981a0f92c97db6a1","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4957e3a9981a0f92c97db6a1: done: 0.016465 sec","job_status":"done","queue_duration_s":1.540559,"scheduling_latency_s":1.540578,"redis_calls":13,"redis_duration_s":0.001789,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00124,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011279,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016465,"completed_at":"2026-08-20T05:53:12.494Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1552gitlab # [ 319.947282] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.495Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6efa3b58008dff37375dd79d","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6efa3b58008dff37375dd79d: start","job_status":"start","queue_duration_s":1.558162,"scheduling_latency_s":1.55818}1553gitlab # [ 319.960094] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.512Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6efa3b58008dff37375dd79d","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6efa3b58008dff37375dd79d: done: 0.017296 sec","job_status":"done","queue_duration_s":1.558162,"scheduling_latency_s":1.55818,"redis_calls":13,"redis_duration_s":0.0017950000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000808,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000987,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012246,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017296,"completed_at":"2026-08-20T05:53:12.512Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1554gitlab # [ 320.000914] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.514Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9a435ca7e3b8603ef3b3730f","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9a435ca7e3b8603ef3b3730f: start","job_status":"start","queue_duration_s":1.576633,"scheduling_latency_s":1.576651}1555gitlab # [ 320.013887] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.530Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9a435ca7e3b8603ef3b3730f","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9a435ca7e3b8603ef3b3730f: done: 0.016474 sec","job_status":"done","queue_duration_s":1.576633,"scheduling_latency_s":1.576651,"redis_calls":13,"redis_duration_s":0.001581,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000558,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001023,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010692,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016474,"completed_at":"2026-08-20T05:53:12.530Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1556gitlab # [ 320.053998] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.532Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a9853b3b8f7cf8b8c7bdd8c7","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a9853b3b8f7cf8b8c7bdd8c7: start","job_status":"start","queue_duration_s":1.595033,"scheduling_latency_s":1.595052}1557gitlab # [ 320.067023] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.549Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a9853b3b8f7cf8b8c7bdd8c7","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a9853b3b8f7cf8b8c7bdd8c7: done: 0.017052 sec","job_status":"done","queue_duration_s":1.595033,"scheduling_latency_s":1.595052,"redis_calls":13,"redis_duration_s":0.001758,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000688,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00107,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011818,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017052,"completed_at":"2026-08-20T05:53:12.549Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1558gitlab # [ 320.107119] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.550Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9278f03dbec482df12fdd6b7","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9278f03dbec482df12fdd6b7: start","job_status":"start","queue_duration_s":1.613379,"scheduling_latency_s":1.613397}1559gitlab # [ 320.119946] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.567Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9278f03dbec482df12fdd6b7","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9278f03dbec482df12fdd6b7: done: 0.017272 sec","job_status":"done","queue_duration_s":1.613379,"scheduling_latency_s":1.613397,"redis_calls":13,"redis_duration_s":0.001779,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000639,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00114,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011979,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017272,"completed_at":"2026-08-20T05:53:12.567Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1560gitlab # [ 320.160358] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.569Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f5ad310957cf7f184c9e0176","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f5ad310957cf7f184c9e0176: start","job_status":"start","queue_duration_s":1.631904,"scheduling_latency_s":1.631924}1561gitlab # [ 320.174114] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.586Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f5ad310957cf7f184c9e0176","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f5ad310957cf7f184c9e0176: done: 0.017123 sec","job_status":"done","queue_duration_s":1.631904,"scheduling_latency_s":1.631924,"redis_calls":13,"redis_duration_s":0.00173,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000624,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001106,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011748,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017123,"completed_at":"2026-08-20T05:53:12.586Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1562gitlab # [ 320.213983] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.587Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9123d2e324239ad585f459cb","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9123d2e324239ad585f459cb: start","job_status":"start","queue_duration_s":1.650252,"scheduling_latency_s":1.65027}1563gitlab # [ 320.226728] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.604Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9123d2e324239ad585f459cb","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9123d2e324239ad585f459cb: done: 0.016605 sec","job_status":"done","queue_duration_s":1.650252,"scheduling_latency_s":1.65027,"redis_calls":13,"redis_duration_s":0.001541,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010477,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016605,"completed_at":"2026-08-20T05:53:12.604Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1564gitlab # [ 320.266995] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.605Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"75a192151429805a793020a1","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-75a192151429805a793020a1: start","job_status":"start","queue_duration_s":1.668292,"scheduling_latency_s":1.668309}1565gitlab # [ 320.279868] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:12.621Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"75a192151429805a793020a1","created_at":"2026-08-20T05:53:10.848Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-cd554ca656594a5a","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"15db2431b18d3c1931f8b596f4b39814","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:10.937Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-75a192151429805a793020a1: done: 0.01601 sec","job_status":"done","queue_duration_s":1.668292,"scheduling_latency_s":1.668309,"redis_calls":13,"redis_duration_s":0.002079,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001547,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011169,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01601,"completed_at":"2026-08-20T05:53:12.621Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1566gitlab # [ 352.012732] postgres[3536]: [3536] ERROR: relation "table_without_models" does not exist1567gitlab # [ 352.013364] postgres[3536]: [3536] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1568gitlab # [ 357.937800] runuser[3145]: pam_unix(runuser:session): session closed for user gitlab1569gitlab # [ 357.938924] setup-gitlab-start[3107]: + mkdir -p /var/lib/secrets1570gitlab # [ 357.944331] setup-gitlab-start[3107]: + echo nixbot-test-token-of-20-chars1571gitlab # [ 357.945274] setup-gitlab-start[3107]: + chmod 644 /var/lib/secrets/gitlab-token1572gitlab # [ 357.950676] setup-gitlab-start[3107]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1573gitlab # [ 360.590513] gitaly[925]: time="2026-08-20T05:53:54.506Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQ98QENRVZSWHKB41DV49 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:54:04.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:53:54.505" pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1574gitlab # [ 360.592743] gitaly[925]: time="2026-08-20T05:53:54.506Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQ98QENRVZSWHKB41DV49 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:54:04.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:53:54.505" grpc.time_ms=0.939 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1575gitlab # [ 361.848667] gitaly[925]: time="2026-08-20T05:53:55.763Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQ98QENRVZSWHKB41DV49 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:54:05.262" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:53:55.763" pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1576gitlab # [ 361.852610] gitaly[925]: time="2026-08-20T05:53:55.764Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQ98QENRVZSWHKB41DV49 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:54:05.262" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:53:55.763" grpc.time_ms=0.767 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1577gitlab # [ 361.917785] gitaly[925]: time="2026-08-20T05:53:55.834Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQ98QENRVZSWHKB41DV49 diskcache=61284ce0-286f-47f7-9316-02e0e95add5f grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T05:54:05.274" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:53:55.775" pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1578gitlab # [ 361.947510] gitaly[925]: time="2026-08-20T05:53:55.834Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=28 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1441 command.oublock=32 command.real_time_ms=34 command.spawn_token_fork_ms=6 command.system_time_ms=25 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQ98QENRVZSWHKB41DV49 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T05:54:05.274" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:53:55.775" grpc.time_ms=59.413 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1579gitlab # [ 361.974812] gitaly[925]: time="2026-08-20T05:53:55.850Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQ98QENRVZSWHKB41DV49 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:54:05.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:53:55.849" pid=925 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1580gitlab # [ 361.992225] gitaly[925]: time="2026-08-20T05:53:55.850Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQ98QENRVZSWHKB41DV49 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:54:05.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:53:55.849" grpc.time_ms=1.399 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1581gitlab # [ 362.011304] gitaly[925]: time="2026-08-20T05:53:55.874Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQ98QENRVZSWHKB41DV49 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:54:05.015" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:53:55.856" grpc.time_ms=18.168 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1582gitlab # [ 362.066724] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:55.981Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"2c2ff2cfed8e5574ec8022d7","created_at":"2026-08-20T05:53:55.899Z","trace_propagation_headers":{"sentry-trace":"212d3ddd922040118ff06e20c11e94e9-9cc1442df7ca4c76","baggage":"sentry-trace_id=212d3ddd922040118ff06e20c11e94e9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVQ98QENRVZSWHKB41DV49","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:55.976Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-2c2ff2cfed8e5574ec8022d7: start","job_status":"start","queue_duration_s":0.005133,"scheduling_latency_s":0.005201}1583gitlab # [ 362.103899] gitaly[925]: time="2026-08-20T05:53:56.020Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQ98QENRVZSWHKB41DV49 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:54:06.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:53:56.019" pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1584gitlab # [ 362.125576] gitaly[925]: time="2026-08-20T05:53:56.020Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQ98QENRVZSWHKB41DV49 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:54:06.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:53:56.019" grpc.time_ms=0.659 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1585gitlab # [ 362.157528] gitaly[925]: time="2026-08-20T05:53:56.074Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQ98QENRVZSWHKB41DV49 diskcache=1776a194-13f0-46ef-ba5e-bb253b5a73e4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T05:54:06.013" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:53:56.024" pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1586gitlab # [ 362.175627] gitaly[925]: time="2026-08-20T05:53:56.074Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=23 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1437 command.oublock=32 command.real_time_ms=27 command.spawn_token_fork_ms=5 command.system_time_ms=23 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQ98QENRVZSWHKB41DV49 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T05:54:06.013" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:53:56.024" grpc.time_ms=50.05 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1587gitlab # [ 362.196222] gitaly[925]: time="2026-08-20T05:53:56.084Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQ98QENRVZSWHKB41DV49 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:54:06.072" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:53:56.083" pid=925 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1588gitlab # [ 362.212241] gitaly[925]: time="2026-08-20T05:53:56.085Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQ98QENRVZSWHKB41DV49 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:54:06.072" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:53:56.083" grpc.time_ms=1.536 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1589gitlab # [ 362.226423] gitaly[925]: time="2026-08-20T05:53:56.109Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQ98QENRVZSWHKB41DV49 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:54:06.082" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:53:56.092" grpc.time_ms=16.473 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1590gitlab # [ 362.243333] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:56.119Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"2c2ff2cfed8e5574ec8022d7","created_at":"2026-08-20T05:53:55.899Z","trace_propagation_headers":{"sentry-trace":"212d3ddd922040118ff06e20c11e94e9-9cc1442df7ca4c76","baggage":"sentry-trace_id=212d3ddd922040118ff06e20c11e94e9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVQ98QENRVZSWHKB41DV49","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:55.976Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-2c2ff2cfed8e5574ec8022d7: done: 0.1381 sec","job_status":"done","queue_duration_s":0.005133,"scheduling_latency_s":0.005201,"redis_calls":13,"redis_duration_s":0.00591,"redis_read_bytes":138,"redis_write_bytes":1593,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.002403,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":428,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001882,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001625,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.098198,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.06490924,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.1381,"completed_at":"2026-08-20T05:53:56.119Z","load_balancing_strategy":"primary","db_duration_s":0.023451,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1591gitlab # [ 362.290411] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:56.120Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"b8067ee885fd2476bce9748b","created_at":"2026-08-20T05:53:55.997Z","trace_propagation_headers":{"sentry-trace":"212d3ddd922040118ff06e20c11e94e9-9cc1442df7ca4c76","baggage":"sentry-trace_id=212d3ddd922040118ff06e20c11e94e9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVQ98QENRVZSWHKB41DV49","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:56.011Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-b8067ee885fd2476bce9748b: start","job_status":"start","queue_duration_s":0.109532,"scheduling_latency_s":0.109561}1592gitlab # [ 362.305125] gitaly[925]: time="2026-08-20T05:53:56.150Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQ98QENRVZSWHKB41DV49 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:54:06.139" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:53:56.150" grpc.time_ms=0.175 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1593gitlab # [ 362.316118] gitaly[925]: time="2026-08-20T05:53:56.161Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQ98QENRVZSWHKB41DV49 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T05:54:06.149" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:53:56.160" grpc.time_ms=0.808 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1594gitlab # [ 362.328798] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:56.244Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"b8067ee885fd2476bce9748b","created_at":"2026-08-20T05:53:55.997Z","trace_propagation_headers":{"sentry-trace":"212d3ddd922040118ff06e20c11e94e9-9cc1442df7ca4c76","baggage":"sentry-trace_id=212d3ddd922040118ff06e20c11e94e9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVQ98QENRVZSWHKB41DV49","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:56.011Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-b8067ee885fd2476bce9748b: done: 0.12402 sec","job_status":"done","queue_duration_s":0.109532,"scheduling_latency_s":0.109561,"redis_calls":14,"redis_duration_s":0.00288,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000648,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001091,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001141,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.097559,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.09433372000000001,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.12402,"completed_at":"2026-08-20T05:53:56.244Z","load_balancing_strategy":"primary","db_duration_s":0.024083,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1595gitlab # [ 362.747448] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:56.663Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"9045b0dd0cb6532a1c98f2af","created_at":"2026-08-20T05:53:56.652Z","trace_propagation_headers":{"sentry-trace":"212d3ddd922040118ff06e20c11e94e9-9cc1442df7ca4c76","baggage":"sentry-trace_id=212d3ddd922040118ff06e20c11e94e9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVQ98QENRVZSWHKB41DV49","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:56.660Z","job_size_bytes":5,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-9045b0dd0cb6532a1c98f2af: start","job_status":"start","queue_duration_s":0.00259,"scheduling_latency_s":0.002652}1596gitlab # [ 362.907770] gitaly[925]: time="2026-08-20T05:53:56.823Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQ98QENRVZSWHKB41DV49 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:54:06.003" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:53:56.804" grpc.time_ms=18.505 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1597gitlab # [ 363.060909] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:56.976Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"9045b0dd0cb6532a1c98f2af","created_at":"2026-08-20T05:53:56.652Z","trace_propagation_headers":{"sentry-trace":"212d3ddd922040118ff06e20c11e94e9-9cc1442df7ca4c76","baggage":"sentry-trace_id=212d3ddd922040118ff06e20c11e94e9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVQ98QENRVZSWHKB41DV49","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:56.660Z","job_size_bytes":5,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-9045b0dd0cb6532a1c98f2af: done: 0.313462 sec","job_status":"done","queue_duration_s":0.00259,"scheduling_latency_s":0.002652,"redis_calls":12,"redis_duration_s":0.005025,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00131,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002822,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000893,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.032,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.032,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.24739,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00053706,"duration_s":0.313462,"completed_at":"2026-08-20T05:53:56.976Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.052928,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1598gitlab # [ 363.164372] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:56.979Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"43548d84e82ee43119c175ef","created_at":"2026-08-20T05:53:56.690Z","trace_propagation_headers":{"sentry-trace":"212d3ddd922040118ff06e20c11e94e9-9cc1442df7ca4c76","baggage":"sentry-trace_id=212d3ddd922040118ff06e20c11e94e9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVQ98QENRVZSWHKB41DV49","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:56.696Z","job_size_bytes":3,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-43548d84e82ee43119c175ef: start","job_status":"start","queue_duration_s":0.282994,"scheduling_latency_s":0.283034}1599gitlab # [ 363.400618] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/08/20:05:53:57 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 54201600gitlab # [ 363.404195] setup-gitlab-start[3107]: + mkdir -p /tmp/test-flake1601gitlab # [ 363.406465] setup-gitlab-start[3107]: + cd /tmp/test-flake1602gitlab # [ 363.407734] setup-gitlab-start[3107]: + git init -b master1603gitlab # [ 363.436806] setup-gitlab-start[3642]: Initialized empty Git repository in /tmp/test-flake/.git/1604gitlab # [ 363.440655] setup-gitlab-start[3107]: + git config user.name test1605gitlab # [ 363.443126] setup-gitlab-start[3107]: + git config user.email test@example.com1606gitlab # [ 363.446284] setup-gitlab-start[3107]: + cat1607gitlab # [ 363.448199] setup-gitlab-start[3107]: + git add flake.nix1608gitlab # [ 363.451812] setup-gitlab-start[3107]: + git commit -m 'initial commit'1609gitlab # [ 363.462007] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:57.377Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"43548d84e82ee43119c175ef","created_at":"2026-08-20T05:53:56.690Z","trace_propagation_headers":{"sentry-trace":"212d3ddd922040118ff06e20c11e94e9-9cc1442df7ca4c76","baggage":"sentry-trace_id=212d3ddd922040118ff06e20c11e94e9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVQ98QENRVZSWHKB41DV49","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:56.696Z","job_size_bytes":3,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-43548d84e82ee43119c175ef: done: 0.397904 sec","job_status":"done","queue_duration_s":0.282994,"scheduling_latency_s":0.283034,"redis_calls":11,"redis_duration_s":0.005125,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00125,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002934,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000941,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":36,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.048,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.306,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.306,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.047,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.295677,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0010305,"duration_s":0.397904,"completed_at":"2026-08-20T05:53:57.377Z","load_balancing_strategy":"primary","db_duration_s":0.102491,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1610gitlab # [ 363.557840] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:57.380Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"59439e4cdaa80df1736ae054","created_at":"2026-08-20T05:53:56.700Z","trace_propagation_headers":{"sentry-trace":"212d3ddd922040118ff06e20c11e94e9-9cc1442df7ca4c76","baggage":"sentry-trace_id=212d3ddd922040118ff06e20c11e94e9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVQ98QENRVZSWHKB41DV49","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:56.705Z","job_size_bytes":89,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-59439e4cdaa80df1736ae054: start","job_status":"start","queue_duration_s":0.675209,"scheduling_latency_s":0.675252}1611gitlab # [ 363.578918] setup-gitlab-start[3647]: [master (root-commit) 42e3f64] initial commit1612gitlab # [ 363.580132] setup-gitlab-start[3647]: 1 file changed, 10 insertions(+)1613gitlab # [ 363.581149] setup-gitlab-start[3647]: create mode 100644 flake.nix1614gitlab # [ 363.582122] setup-gitlab-start[3107]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1615gitlab # [ 363.583872] setup-gitlab-start[3107]: + git push -u origin master1616gitlab # [ 363.586742] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:57.502Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"59439e4cdaa80df1736ae054","created_at":"2026-08-20T05:53:56.700Z","trace_propagation_headers":{"sentry-trace":"212d3ddd922040118ff06e20c11e94e9-9cc1442df7ca4c76","baggage":"sentry-trace_id=212d3ddd922040118ff06e20c11e94e9,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVQ98QENRVZSWHKB41DV49","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:56.705Z","job_size_bytes":89,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-59439e4cdaa80df1736ae054: done: 0.122102 sec","job_status":"done","queue_duration_s":0.675209,"scheduling_latency_s":0.675252,"redis_calls":11,"redis_duration_s":0.003818,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000855,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002409,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000554,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":9,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.07773,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00068604,"duration_s":0.122102,"completed_at":"2026-08-20T05:53:57.502Z","load_balancing_strategy":"primary","db_duration_s":0.033072,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1617gitlab # [ 363.752756] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/08/20:05:53:57 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 2441618gitlab # [ 363.960370] gitaly[925]: time="2026-08-20T05:53:57.875Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=21 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=3 command.system_time_ms=18 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQEX6ZKDB7FZFEN4DV95J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:53:57.846" grpc.time_ms=28.626 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1619gitlab # [ 363.998632] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/08/20:05:53:57 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 2051620gitlab # [ 364.679378] gitaly[925]: time="2026-08-20T05:53:58.595Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=2 command.system_time_ms=18 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQF45DRQRAQTJN6RFD1RS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:54:08.010" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:53:58.571" grpc.time_ms=23.916 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1621gitlab # [ 364.810980] gitaly[925]: time="2026-08-20T05:53:58.727Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQF45DRQRAQTJN6RFD1RS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-20T05:54:28.004" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-20T05:53:58.705" grpc.time_ms=21.49 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1622gitlab # [ 364.952570] gitaly[925]: time="2026-08-20T05:53:58.868Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M0EVQF45DRQRAQTJN6RFD1RS duration_ms=748ns method=POST pid=925 status=200 url="http://unix/api/v4/internal/allowed"1623gitlab # [ 365.011911] gitaly[925]: time="2026-08-20T05:53:58.927Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M0EVQF45DRQRAQTJN6RFD1RS duration_ms=56ns method=POST pid=925 status=200 url="http://unix/api/v4/internal/pre_receive"1624gitlab # [ 365.021518] gitaly[925]: time="2026-08-20T05:53:58.928Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVQF45DRQRAQTJN6RFD1RS grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5315 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:53:58.115" grpc.time_ms=812.249 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1625gitlab # [ 365.073862] gitaly[925]: time="2026-08-20T05:53:58.990Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVQF45DRQRAQTJN6RFD1RS grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:53:58.987" grpc.time_ms=2.662 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1626gitlab # [ 365.141420] gitaly[925]: time="2026-08-20T05:53:59.057Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVQF45DRQRAQTJN6RFD1RS grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4784 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:53:59.055" grpc.time_ms=1.652 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1627gitlab # [ 365.216561] gitaly[925]: time="2026-08-20T05:53:59.131Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVQF45DRQRAQTJN6RFD1RS grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:53:59.130" grpc.time_ms=1.497 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1628gitlab # [ 365.408790] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:59.322Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 42e3f64711217c5a5b26574a2bedc4bb007a4058 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"6102dcab6c6318d4c3dcea6e","created_at":"2026-08-20T05:53:59.305Z","trace_propagation_headers":{"sentry-trace":"1e4f8821e47640e6b5b28930a1937efc-97303fab1a91489e","baggage":"sentry-trace_id=1e4f8821e47640e6b5b28930a1937efc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVQF45DRQRAQTJN6RFD1RS","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:59.318Z","job_size_bytes":185,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-6102dcab6c6318d4c3dcea6e: start","job_status":"start","queue_duration_s":0.003745,"scheduling_latency_s":0.003824}1629gitlab # [ 365.458420] gitaly[925]: time="2026-08-20T05:53:59.373Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=4 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQF45DRQRAQTJN6RFD1RS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:54:09.008" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:53:59.358" grpc.time_ms=14.135 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1630gitlab # [ 365.495250] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:53:59.411Z","message":"changes: \"0000000000000000000000000000000000000000 42e3f64711217c5a5b26574a2bedc4bb007a4058 refs/heads/master\\n\""}1631gitlab # [ 365.543042] gitaly[925]: time="2026-08-20T05:53:59.459Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=43 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1432 command.oublock=0 command.real_time_ms=54 command.spawn_token_fork_ms=7 command.system_time_ms=28 command.user_time_ms=15 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQF45DRQRAQTJN6RFD1RS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-20T05:54:09.046" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:53:59.397" grpc.time_ms=60.895 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1632gitlab # [ 365.591407] gitaly[925]: time="2026-08-20T05:53:59.507Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M0EVQF45DRQRAQTJN6RFD1RS duration_ms=305ns method=POST pid=925 status=200 url="http://unix/api/v4/internal/post_receive"1633gitlab # [ 365.601079] gitaly[925]: time="2026-08-20T05:53:59.509Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVQF45DRQRAQTJN6RFD1RS grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4809 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:53:59.201" grpc.time_ms=308.176 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1634gitlab # [ 365.632825] gitaly[925]: time="2026-08-20T05:53:59.524Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M0EVQF45DRQRAQTJN6RFD1RS diskcache=ea85435c-1d1f-4e12-963e-4d11fd4db2b8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:53:57.994" pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1635gitlab # [ 365.655488] systemd[1]: Finished setup-gitlab.service.1636gitlab # [ 365.657935] gitlab-workhorse[823]: time="2026-08-20T05:53:59Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521637gitlab # [ 365.661908] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/08/20:05:53:59 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 16331638gitlab # [ 365.666080] setup-gitlab-start[3651]: To http://gitlab/root/test-flake.git1639gitlab # [ 365.667751] setup-gitlab-start[3651]: * [new branch] master -> master1640gitlab # [ 365.669538] setup-gitlab-start[3651]: branch 'master' set up to track 'origin/master'.1641gitlab # [ 365.671361] gitaly[925]: time="2026-08-20T05:53:59.527Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=430 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=851968 command.minflt=13767 command.oublock=32 command.real_time_ms=1518 command.spawn_token_fork_ms=3 command.system_time_ms=256 command.user_time_ms=174 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQF45DRQRAQTJN6RFD1RS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:53:57.994" grpc.time_ms=1530.435 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1642gitlab # [ 365.693568] systemd[1]: Starting nixbot CI service...1643gitlab # [ 365.694758] gitaly[925]: time="2026-08-20T05:53:59.533Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQF45DRQRAQTJN6RFD1RS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:54:09.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:53:59.522" grpc.time_ms=11.212 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1644gitlab # [ 365.713687] gitaly[925]: time="2026-08-20T05:53:59.553Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=3 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQF45DRQRAQTJN6RFD1RS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:54:09.021" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:53:59.542" grpc.time_ms=10.645 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1645gitlab # [ 365.730732] gitaly[925]: time="2026-08-20T05:53:59.629Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=3 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQF45DRQRAQTJN6RFD1RS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-20T05:54:09.091" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=226 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:53:59.613" grpc.time_ms=15.697 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1646gitlab # [ 365.770304] gitaly[925]: time="2026-08-20T05:53:59.686Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVQF45DRQRAQTJN6RFD1RS grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3936 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:53:59.686" grpc.time_ms=0.573 pid=925 span.kind=server system=grpc1647gitlab # [ 365.806767] gitaly[925]: time="2026-08-20T05:53:59.723Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVQF45DRQRAQTJN6RFD1RS grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3938 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:53:59.722" grpc.time_ms=0.567 pid=925 span.kind=server system=grpc1648gitlab # [ 365.826331] gitaly[925]: time="2026-08-20T05:53:59.737Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQF45DRQRAQTJN6RFD1RS diskcache=aed14d20-abc8-4b6f-9777-ffd7c3e93418 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T05:54:09.120" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:53:59.641" pid=925 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1649gitlab # [ 365.844188] gitaly[925]: time="2026-08-20T05:53:59.737Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=88 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=4947 command.oublock=8 command.real_time_ms=85 command.spawn_token_fork_ms=1 command.system_time_ms=47 command.user_time_ms=41 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQF45DRQRAQTJN6RFD1RS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T05:54:09.120" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:53:59.641" grpc.time_ms=95.677 pid=925 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1650gitlab # [ 365.872989] gitaly[925]: time="2026-08-20T05:53:59.758Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQF45DRQRAQTJN6RFD1RS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:54:09.237" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:53:59.758" grpc.time_ms=0.207 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1651gitlab # [ 365.889726] gitaly[925]: time="2026-08-20T05:53:59.775Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=858 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQF45DRQRAQTJN6RFD1RS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-20T05:54:09.242" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:53:59.763" grpc.time_ms=12.276 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1652gitlab # [ 366.023588] gitaly[925]: time="2026-08-20T05:53:59.939Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=313 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQF45DRQRAQTJN6RFD1RS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-08-20T05:54:29.020" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:53:59.921" grpc.time_ms=17.979 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1653gitlab # [ 366.094210] gitaly[925]: time="2026-08-20T05:54:00.010Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQF45DRQRAQTJN6RFD1RS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T05:54:10.008" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:54:00.009" grpc.time_ms=0.903 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1654gitlab # [ 366.118348] gitaly[925]: time="2026-08-20T05:54:00.025Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=316 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQF45DRQRAQTJN6RFD1RS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-20T05:54:10.015" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-08-20T05:54:00.016" grpc.time_ms=8.483 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1655gitlab # [ 366.142084] gitaly[925]: time="2026-08-20T05:54:00.056Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQF45DRQRAQTJN6RFD1RS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:54:10.045" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:54:00.046" grpc.time_ms=10.097 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1656gitlab # [ 366.162509] gitaly[925]: time="2026-08-20T05:54:00.074Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQF45DRQRAQTJN6RFD1RS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:54:10.063" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:54:00.064" grpc.time_ms=10.493 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1657gitlab # [ 366.190543] gitaly[925]: time="2026-08-20T05:54:00.106Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=880 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQF45DRQRAQTJN6RFD1RS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-20T05:54:30.090" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:00.090" grpc.time_ms=15.971 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1658gitlab: (finished: waiting for unit setup-gitlab.service, in 366.93 seconds)1659gitlab: waiting for unit nixbot.service1660gitlab # [ 366.841085] gitaly[925]: time="2026-08-20T05:54:00.757Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQF45DRQRAQTJN6RFD1RS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-20T05:54:10.231" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:00.751" grpc.time_ms=5.286 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1661gitlab # [ 366.927262] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:00.841Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 42e3f64711217c5a5b26574a2bedc4bb007a4058 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"6102dcab6c6318d4c3dcea6e","created_at":"2026-08-20T05:53:59.305Z","trace_propagation_headers":{"sentry-trace":"1e4f8821e47640e6b5b28930a1937efc-97303fab1a91489e","baggage":"sentry-trace_id=1e4f8821e47640e6b5b28930a1937efc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVQF45DRQRAQTJN6RFD1RS","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:53:59.318Z","job_size_bytes":185,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-6102dcab6c6318d4c3dcea6e: done: 1.519319 sec","job_status":"done","queue_duration_s":0.003745,"scheduling_latency_s":0.003824,"gitaly_calls":13,"gitaly_duration_s":0.277337,"redis_calls":197,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.08541800000000001,"redis_read_bytes":1593,"redis_write_bytes":18993,"redis_cache_calls":15,"redis_cache_duration_s":0.006614,"redis_cache_read_bytes":20,"redis_cache_write_bytes":888,"redis_feature_flag_calls":29,"redis_feature_flag_duration_s":0.013962,"redis_feature_flag_read_bytes":1172,"redis_feature_flag_write_bytes":3542,"redis_queues_calls":8,"redis_queues_duration_s":0.002101,"redis_queues_read_bytes":8,"redis_queues_write_bytes":4932,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.008524,"redis_queues_metadata_read_bytes":11,"redis_queues_metadata_write_bytes":1259,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.023833,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.030384,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.108,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.366,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.419,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.108,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.045087,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00292074,"exclusive_lock_hold_duration_s":0.06980244,"duration_s":1.519319,"completed_at":"2026-08-20T05:54:00.841Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.172962,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1662gitlab # [ 367.074609] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:00.844Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"0ba1a922191891556be02aaf","created_at":"2026-08-20T05:53:59.557Z","trace_propagation_headers":{"sentry-trace":"1e4f8821e47640e6b5b28930a1937efc-1db963eef18c4d7a","baggage":"sentry-trace_id=1e4f8821e47640e6b5b28930a1937efc,sentry-release=Unknown"},"correlation_id":"01M0EVQF45DRQRAQTJN6RFD1RS","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:59.568Z","job_size_bytes":46,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-0ba1a922191891556be02aaf: start","job_status":"start","queue_duration_s":1.276611,"scheduling_latency_s":1.276648}1663gitlab # [ 367.106337] gitaly[925]: time="2026-08-20T05:54:00.942Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQF45DRQRAQTJN6RFD1RS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-08-20T11:54:00.928" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:54:00.929" grpc.time_ms=12.002 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1664gitlab # [ 367.125824] gitaly[925]: time="2026-08-20T05:54:00.980Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=593 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=11 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQF45DRQRAQTJN6RFD1RS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-20T05:54:30.055" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:00.956" grpc.time_ms=23.723 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1665gitlab # [ 367.149455] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:01.038Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"0ba1a922191891556be02aaf","created_at":"2026-08-20T05:53:59.557Z","trace_propagation_headers":{"sentry-trace":"1e4f8821e47640e6b5b28930a1937efc-1db963eef18c4d7a","baggage":"sentry-trace_id=1e4f8821e47640e6b5b28930a1937efc,sentry-release=Unknown"},"correlation_id":"01M0EVQF45DRQRAQTJN6RFD1RS","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:59.568Z","job_size_bytes":46,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-0ba1a922191891556be02aaf: done: 0.19415 sec","job_status":"done","queue_duration_s":1.276611,"scheduling_latency_s":1.276648,"gitaly_calls":2,"gitaly_duration_s":0.044133,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.013738,"redis_read_bytes":68,"redis_write_bytes":4889,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.002922,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.001294,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2116,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003012,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.005311,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":754,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001199,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.112137,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00050582,"duration_s":0.19415,"completed_at":"2026-08-20T05:54:01.038Z","load_balancing_strategy":"primary","db_duration_s":0.024391,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1666gitlab # [ 367.218874] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:01.042Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"7a8d33093f251b2c53d04a92","created_at":"2026-08-20T05:53:59.597Z","trace_propagation_headers":{"sentry-trace":"1e4f8821e47640e6b5b28930a1937efc-1db963eef18c4d7a","baggage":"sentry-trace_id=1e4f8821e47640e6b5b28930a1937efc,sentry-release=Unknown"},"correlation_id":"01M0EVQF45DRQRAQTJN6RFD1RS","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:59.605Z","job_size_bytes":3,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-7a8d33093f251b2c53d04a92: start","job_status":"start","queue_duration_s":1.435995,"scheduling_latency_s":1.436034}1667gitlab # [ 367.241011] gitaly[925]: time="2026-08-20T05:54:01.145Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQF45DRQRAQTJN6RFD1RS diskcache=77c6aa03-3baa-4333-a0d6-e8d99d28973a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T11:54:01.086" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:01.087" pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1668gitlab # [ 367.252806] gitaly[925]: time="2026-08-20T05:54:01.145Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=35 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1172 command.oublock=0 command.real_time_ms=71 command.spawn_token_fork_ms=7 command.system_time_ms=31 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQF45DRQRAQTJN6RFD1RS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T11:54:01.086" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:01.087" grpc.time_ms=58.314 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1669gitlab # [ 367.326181] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:01.241Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"7a8d33093f251b2c53d04a92","created_at":"2026-08-20T05:53:59.597Z","trace_propagation_headers":{"sentry-trace":"1e4f8821e47640e6b5b28930a1937efc-1db963eef18c4d7a","baggage":"sentry-trace_id=1e4f8821e47640e6b5b28930a1937efc,sentry-release=Unknown"},"correlation_id":"01M0EVQF45DRQRAQTJN6RFD1RS","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:59.605Z","job_size_bytes":3,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-7a8d33093f251b2c53d04a92: done: 0.199696 sec","job_status":"done","queue_duration_s":1.435995,"scheduling_latency_s":1.436034,"gitaly_calls":1,"gitaly_duration_s":0.062783,"redis_calls":15,"redis_duration_s":0.006257,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000673,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002272,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001154,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002158,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.027,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.052,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.093234,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.15242794,"duration_s":0.199696,"completed_at":"2026-08-20T05:54:01.241Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.037827,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1670gitlab # [ 367.397381] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:01.245Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"9a617c2b35e1be33975cf6c8","created_at":"2026-08-20T05:53:59.750Z","trace_propagation_headers":{"sentry-trace":"1e4f8821e47640e6b5b28930a1937efc-1db963eef18c4d7a","baggage":"sentry-trace_id=1e4f8821e47640e6b5b28930a1937efc,sentry-release=Unknown"},"correlation_id":"01M0EVQF45DRQRAQTJN6RFD1RS","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:59.753Z","job_size_bytes":23,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-9a617c2b35e1be33975cf6c8: start","job_status":"start","queue_duration_s":1.491979,"scheduling_latency_s":1.492019}1671gitlab # [ 367.416239] gitaly[925]: time="2026-08-20T05:54:01.329Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=592 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=3 command.system_time_ms=11 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQF45DRQRAQTJN6RFD1RS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-20T05:54:31.307" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:01.308" grpc.time_ms=21.061 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1672gitlab # [ 367.434134] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:01.349Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"9a617c2b35e1be33975cf6c8","created_at":"2026-08-20T05:53:59.750Z","trace_propagation_headers":{"sentry-trace":"1e4f8821e47640e6b5b28930a1937efc-1db963eef18c4d7a","baggage":"sentry-trace_id=1e4f8821e47640e6b5b28930a1937efc,sentry-release=Unknown"},"correlation_id":"01M0EVQF45DRQRAQTJN6RFD1RS","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-20T05:53:59.753Z","job_size_bytes":23,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-9a617c2b35e1be33975cf6c8: done: 0.104377 sec","job_status":"done","queue_duration_s":1.491979,"scheduling_latency_s":1.492019,"gitaly_calls":1,"gitaly_duration_s":0.025302,"redis_calls":16,"redis_duration_s":0.007421,"redis_read_bytes":52,"redis_write_bytes":2048,"redis_queues_calls":1,"redis_queues_duration_s":0.000594,"redis_queues_read_bytes":1,"redis_queues_write_bytes":979,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00273,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.002873,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001224,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.059793,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.104377,"completed_at":"2026-08-20T05:54:01.349Z","load_balancing_strategy":"primary","db_duration_s":0.007083,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1673gitlab # [ 367.488867] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:01.352Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"c61f1aa56105f9da40479b5b","created_at":"2026-08-20T05:54:00.595Z","trace_propagation_headers":{"sentry-trace":"1e4f8821e47640e6b5b28930a1937efc-1db963eef18c4d7a","baggage":"sentry-trace_id=1e4f8821e47640e6b5b28930a1937efc,sentry-release=Unknown"},"correlation_id":"01M0EVQF45DRQRAQTJN6RFD1RS","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5ec2eaee2fcd6ba62a619e290227ab52fdc44789a37fa74ffe9a6323b979e1c","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:00.612Z","job_size_bytes":467,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-c61f1aa56105f9da40479b5b: start","job_status":"start","queue_duration_s":0.739962,"scheduling_latency_s":0.740019}1674gitlab # [ 367.514408] gitaly[925]: time="2026-08-20T05:54:01.430Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQF45DRQRAQTJN6RFD1RS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:54:31.428" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:01.428" grpc.time_ms=1.145 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1675gitlab # [ 367.534308] gitaly[925]: time="2026-08-20T05:54:01.450Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQF45DRQRAQTJN6RFD1RS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T05:54:11.004" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:54:01.435" grpc.time_ms=13.502 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1676gitlab # [ 367.623784] nixbot[3752]: {"ts": "2026-08-20T05:54:01.539Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1677gitlab # [ 367.676447] nixbot[3752]: {"ts": "2026-08-20T05:54:01.592Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1678gitlab # [ 367.732278] nixbot[3752]: {"ts": "2026-08-20T05:54:01.648Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1679gitlab # [ 367.741616] nixbot[3752]: {"ts": "2026-08-20T05:54:01.657Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1680gitlab # [ 367.749369] nixbot[3752]: {"ts": "2026-08-20T05:54:01.665Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1681gitlab # [ 367.755953] gitaly[925]: time="2026-08-20T05:54:01.667Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQF45DRQRAQTJN6RFD1RS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T05:54:31.662" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:01.663" grpc.time_ms=3.289 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1682gitlab # [ 367.793819] gitaly[925]: time="2026-08-20T05:54:01.683Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=225 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=2 command.system_time_ms=0 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQF45DRQRAQTJN6RFD1RS error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-20T05:54:31.673" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:01.675" grpc.time_ms=7.63 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1683gitlab # [ 367.834344] nixbot[3752]: {"ts": "2026-08-20T05:54:01.677Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1684gitlab # [ 367.839433] nixbot[3752]: {"ts": "2026-08-20T05:54:01.685Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1685gitlab # [ 367.844389] nixbot[3752]: {"ts": "2026-08-20T05:54:01.689Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1686gitlab # [ 367.848938] nixbot[3752]: {"ts": "2026-08-20T05:54:01.704Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1687gitlab # [ 367.853525] nixbot[3752]: {"ts": "2026-08-20T05:54:01.708Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1688gitlab # [ 367.858118] nixbot[3752]: {"ts": "2026-08-20T05:54:01.718Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1689gitlab # [ 367.862449] nixbot[3752]: {"ts": "2026-08-20T05:54:01.729Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1690gitlab # [ 367.866536] nixbot[3752]: {"ts": "2026-08-20T05:54:01.733Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1691gitlab # [ 367.870489] nixbot[3752]: {"ts": "2026-08-20T05:54:01.735Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1692gitlab # [ 367.874358] nixbot[3752]: {"ts": "2026-08-20T05:54:01.741Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1693gitlab # [ 367.877971] nixbot[3752]: {"ts": "2026-08-20T05:54:01.744Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1694gitlab # [ 367.881188] nixbot[3752]: {"ts": "2026-08-20T05:54:01.746Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1695gitlab # [ 367.884301] nixbot[3752]: {"ts": "2026-08-20T05:54:01.748Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1696gitlab # [ 367.887190] nixbot[3752]: {"ts": "2026-08-20T05:54:01.754Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1697gitlab # [ 367.890348] nixbot[3752]: {"ts": "2026-08-20T05:54:01.756Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1698gitlab # [ 367.894016] nixbot[3752]: {"ts": "2026-08-20T05:54:01.758Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1699gitlab # [ 367.899068] nixbot[3752]: {"ts": "2026-08-20T05:54:01.765Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1700gitlab # [ 367.903485] nixbot[3752]: {"ts": "2026-08-20T05:54:01.767Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1701gitlab # [ 367.906453] nixbot[3752]: {"ts": "2026-08-20T05:54:01.769Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1702gitlab # [ 367.913497] nixbot[3752]: {"ts": "2026-08-20T05:54:01.772Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1703gitlab # [ 367.972994] gitaly[925]: time="2026-08-20T05:54:01.889Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=3 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQF45DRQRAQTJN6RFD1RS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:54:11.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:54:01.868" grpc.time_ms=20.672 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1704gitlab # [ 368.544876] nixbot[3752]: INFO: Started server process [3752]1705gitlab # [ 368.552397] nixbot[3752]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1706gitlab # [ 368.567290] nixbot[3752]: INFO: ::ffff:127.0.0.1:54658 - "GET /health HTTP/1.1" 200 OK1707gitlab # [ 368.574379] systemd[1]: Started nixbot CI service.1708gitlab # [ 368.577417] systemd[1]: Reached target Multi-User System.1709gitlab # [ 368.578722] systemd[1]: Startup finished in 689ms (kernel) + 4.225s (initrd) + 6min 3.664s (userspace) = 6min 8.578s.1710gitlab: (finished: waiting for unit nixbot.service, in 2.14 seconds)1711gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1712gitlab # [ 368.660611] nixbot[3752]: INFO: ::ffff:127.0.0.1:54672 - "GET /health HTTP/1.1" 200 OK1713gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.04 seconds)1714subtest: project discovered and webhook registered1715gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1716gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.28 seconds)1717gitlab # [ 368.937852] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/08/20:05:54:02 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 2341718gitlab # [ 368.945449] gitaly[925]: time="2026-08-20T05:54:02.860Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=879 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=6 command.system_time_ms=9 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQKKJWP5ECN7FHPXKWH72 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-20T05:54:32.034" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:02.834" grpc.time_ms=25.125 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1719gitlab # [ 369.003670] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/08/20:05:54:02 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 4351720gitlab # [ 369.009988] nixbot[3752]: {"ts": "2026-08-20T05:54:02.920Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1721gitlab # [ 369.015760] gitaly[925]: time="2026-08-20T05:54:02.931Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=881 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQF45DRQRAQTJN6RFD1RS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-20T05:54:32.010" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:02.911" grpc.time_ms=19.754 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1722gitlab # [ 369.044819] gitaly[925]: time="2026-08-20T05:54:02.952Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=3 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQF45DRQRAQTJN6RFD1RS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-20T05:54:32.038" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:02.939" grpc.time_ms=13.565 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1723gitlab # [ 369.066813] nixbot[3752]: {"ts": "2026-08-20T05:54:02.943Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1724gitlab # [ 369.112878] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/08/20:05:54:03 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 721725gitlab # [ 369.118619] nixbot[3752]: {"ts": "2026-08-20T05:54:03.031Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1726gitlab # [ 369.124944] nixbot[3752]: {"ts": "2026-08-20T05:54:03.034Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1727gitlab # [ 369.194215] sidekiq-cluster[2156]: {"severity":"WARN","time":"2026-08-20T05:54:03.109Z","class":"CreatePipelineWorker","correlation_id":"01M0EVQF45DRQRAQTJN6RFD1RS","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"42e3f64711217c5a5b26574a2bedc4bb007a4058","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"42e3f64711217c5a5b26574a2bedc4bb007a4058","ref":"refs/heads/master"},"retry":0}1728gitlab # [ 369.234483] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:03.147Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"c61f1aa56105f9da40479b5b","created_at":"2026-08-20T05:54:00.595Z","trace_propagation_headers":{"sentry-trace":"1e4f8821e47640e6b5b28930a1937efc-1db963eef18c4d7a","baggage":"sentry-trace_id=1e4f8821e47640e6b5b28930a1937efc,sentry-release=Unknown"},"correlation_id":"01M0EVQF45DRQRAQTJN6RFD1RS","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5ec2eaee2fcd6ba62a619e290227ab52fdc44789a37fa74ffe9a6323b979e1c","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:00.612Z","job_size_bytes":467,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-c61f1aa56105f9da40479b5b: done: 1.794774 sec","job_status":"done","queue_duration_s":0.739962,"scheduling_latency_s":0.740019,"gitaly_calls":7,"gitaly_duration_s":0.118513,"redis_calls":51,"redis_duration_s":0.071881,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.002116,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.058756,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001964,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.005595,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00345,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.098,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.074,"db_ci_duration_s":0.024,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.209411,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00047448,"duration_s":1.794774,"completed_at":"2026-08-20T05:54:03.147Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.372066,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1729gitlab # [ 369.317829] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:03.156Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"476e63268f0fc2e3d895fca4","created_at":"2026-08-20T05:54:01.001Z","trace_propagation_headers":{"sentry-trace":"1e4f8821e47640e6b5b28930a1937efc-8e4acde73de847f5","baggage":"sentry-trace_id=1e4f8821e47640e6b5b28930a1937efc,sentry-release=Unknown"},"correlation_id":"01M0EVQF45DRQRAQTJN6RFD1RS","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:01.013Z","job_size_bytes":3,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-476e63268f0fc2e3d895fca4: start","job_status":"start","queue_duration_s":2.142584,"scheduling_latency_s":2.142637}1730gitlab # [ 369.397053] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/08/20:05:54:03 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 2751731gitlab # [ 369.401739] nixbot[3752]: {"ts": "2026-08-20T05:54:03.314Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1732gitlab # [ 369.565144] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:03.479Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"476e63268f0fc2e3d895fca4","created_at":"2026-08-20T05:54:01.001Z","trace_propagation_headers":{"sentry-trace":"1e4f8821e47640e6b5b28930a1937efc-8e4acde73de847f5","baggage":"sentry-trace_id=1e4f8821e47640e6b5b28930a1937efc,sentry-release=Unknown"},"correlation_id":"01M0EVQF45DRQRAQTJN6RFD1RS","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:01.013Z","job_size_bytes":3,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-476e63268f0fc2e3d895fca4: done: 0.323423 sec","job_status":"done","queue_duration_s":2.142584,"scheduling_latency_s":2.142637,"redis_calls":19,"redis_duration_s":0.036415,"redis_read_bytes":22,"redis_write_bytes":4291,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00666,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.003668,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2262,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.013424,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.012663,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.066,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.011,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.011,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.066,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.11135,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.061530999999999995,"duration_s":0.323423,"completed_at":"2026-08-20T05:54:03.479Z","load_balancing_strategy":"primary","db_duration_s":0.079006,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1733gitlab # [ 369.663994] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:03.491Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"8a146386ed5658e5052e3c42","created_at":"2026-08-20T05:54:02.567Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"306600fd04bf957bc6b42b2a141b01a0","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:02.681Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-8a146386ed5658e5052e3c42: start","job_status":"start","queue_duration_s":0.809675,"scheduling_latency_s":0.809708}1734gitlab # [ 369.681327] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:03.580Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"8a146386ed5658e5052e3c42","created_at":"2026-08-20T05:54:02.567Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"306600fd04bf957bc6b42b2a141b01a0","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:02.681Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-8a146386ed5658e5052e3c42: done: 0.089103 sec","job_status":"done","queue_duration_s":0.809675,"scheduling_latency_s":0.809708,"redis_calls":12,"redis_duration_s":0.019281,"redis_read_bytes":10,"redis_write_bytes":1576,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001262,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.015851,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002168,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031392,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01448898,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.089103,"completed_at":"2026-08-20T05:54:03.580Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.021528,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1735gitlab # [ 369.725881] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:03.583Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"950a6c226068063242c12672","created_at":"2026-08-20T05:54:02.702Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1dbfa8e5b83041dcaf263e6c82fff6bb","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:02.718Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-950a6c226068063242c12672: start","job_status":"start","queue_duration_s":0.864581,"scheduling_latency_s":0.864615}1736gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1737gitlab # [ 369.888301] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:03.802Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"950a6c226068063242c12672","created_at":"2026-08-20T05:54:02.702Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1dbfa8e5b83041dcaf263e6c82fff6bb","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:02.718Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-950a6c226068063242c12672: done: 0.218875 sec","job_status":"done","queue_duration_s":0.864581,"scheduling_latency_s":0.864615,"redis_calls":15,"redis_duration_s":0.024301,"redis_read_bytes":13,"redis_write_bytes":1859,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.015822,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003905,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004574,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.057248,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.218875,"completed_at":"2026-08-20T05:54:03.802Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0283,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1738gitlab # [ 369.949452] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:03.813Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"21a4eab66caafe556672d494","created_at":"2026-08-20T05:54:02.858Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b804b6fe7725b58c51d911ec8d3876aa","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:02.883Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-21a4eab66caafe556672d494: start","job_status":"start","queue_duration_s":0.929992,"scheduling_latency_s":0.93006}1739gitlab # [ 370.030255] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:03.945Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"21a4eab66caafe556672d494","created_at":"2026-08-20T05:54:02.858Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b804b6fe7725b58c51d911ec8d3876aa","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:02.883Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-21a4eab66caafe556672d494: done: 0.132617 sec","job_status":"done","queue_duration_s":0.929992,"scheduling_latency_s":0.93006,"redis_calls":11,"redis_duration_s":0.040441000000000005,"redis_read_bytes":9,"redis_write_bytes":1386,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.005329,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.031411,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003701,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.029,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040538,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.132617,"completed_at":"2026-08-20T05:54:03.945Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.029096,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1740gitlab # [ 370.074249] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:03.948Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"605f3b3da98c27e285fae287","created_at":"2026-08-20T05:54:02.900Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aa1f4c0c814f203bcf4a61d51dc2eb71","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:02.913Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-605f3b3da98c27e285fae287: start","job_status":"start","queue_duration_s":1.034742,"scheduling_latency_s":1.034786}1741gitlab # [ 370.088801] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:03.993Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"605f3b3da98c27e285fae287","created_at":"2026-08-20T05:54:02.900Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aa1f4c0c814f203bcf4a61d51dc2eb71","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:02.913Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-605f3b3da98c27e285fae287: done: 0.045338 sec","job_status":"done","queue_duration_s":1.034742,"scheduling_latency_s":1.034786,"redis_calls":9,"redis_duration_s":0.00266,"redis_read_bytes":7,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000568,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001532,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00056,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.045338,"completed_at":"2026-08-20T05:54:03.993Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003111,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1742gitlab # [ 370.131744] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:03.996Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"c22befad79a2b348d94b727d","created_at":"2026-08-20T05:54:02.928Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6aa40e955281fddf436d4cef70ecda29","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:02.941Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-c22befad79a2b348d94b727d: start","job_status":"start","queue_duration_s":1.054576,"scheduling_latency_s":1.054611}1743gitlab # [ 370.145175] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:04.023Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"c22befad79a2b348d94b727d","created_at":"2026-08-20T05:54:02.928Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6aa40e955281fddf436d4cef70ecda29","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:02.941Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-c22befad79a2b348d94b727d: done: 0.027787 sec","job_status":"done","queue_duration_s":1.054576,"scheduling_latency_s":1.054611,"redis_calls":11,"redis_duration_s":0.002767,"redis_read_bytes":8,"redis_write_bytes":1094,"redis_cache_calls":2,"redis_cache_duration_s":0.000377,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000993,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001015,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":482,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000382,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018376,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027787,"completed_at":"2026-08-20T05:54:04.023Z","load_balancing_strategy":"primary","db_duration_s":0.001304,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1744gitlab # [ 370.189094] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:04.025Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"fe6ea63f53615cd4936fc284","created_at":"2026-08-20T05:54:02.951Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9c8eae0ecbda1181b8a11ee8b6b2537c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T05:54:02.970Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-fe6ea63f53615cd4936fc284: start","job_status":"start","queue_duration_s":1.055035,"scheduling_latency_s":1.055059}1745gitlab # [ 370.204668] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:04.041Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1746gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.27 seconds)1747(finished: subtest: project discovered and webhook registered, in 1.55 seconds)1748subtest: push delivers the webhook1749gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1750gitlab # [ 370.208042] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:04.049Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"fe6ea63f53615cd4936fc284","created_at":"2026-08-20T05:54:02.951Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9c8eae0ecbda1181b8a11ee8b6b2537c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T05:54:02.970Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-fe6ea63f53615cd4936fc284: done: 0.023507 sec","job_status":"done","queue_duration_s":1.055035,"scheduling_latency_s":1.055059,"redis_calls":9,"redis_duration_s":0.001683,"redis_read_bytes":7,"redis_write_bytes":1152,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000385,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000939,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000359,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016422,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023507,"completed_at":"2026-08-20T05:54:04.048Z","load_balancing_strategy":"primary","db_duration_s":0.000683,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1751gitlab # [ 370.248818] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:04.050Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"984297dd3e2fae8f5cf7927b","created_at":"2026-08-20T05:54:02.977Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aad19c2da4ec987bdc07b6822149b211","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:02.987Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-984297dd3e2fae8f5cf7927b: start","job_status":"start","queue_duration_s":1.062701,"scheduling_latency_s":1.062725}1752gitlab # [ 370.263587] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/08/20:05:54:04 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 1631753gitlab # [ 370.265672] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:04.104Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"984297dd3e2fae8f5cf7927b","created_at":"2026-08-20T05:54:02.977Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aad19c2da4ec987bdc07b6822149b211","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:02.987Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-984297dd3e2fae8f5cf7927b: done: 0.0542 sec","job_status":"done","queue_duration_s":1.062701,"scheduling_latency_s":1.062725,"redis_calls":13,"redis_duration_s":0.002448,"redis_read_bytes":11,"redis_write_bytes":1780,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00074,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000882,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000826,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036017,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00069346,"exclusive_lock_hold_duration_s":0.0259749,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.0542,"completed_at":"2026-08-20T05:54:04.104Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013145,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1754gitlab # [ 370.310741] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:04.106Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"090bafaae2819d364892c813","created_at":"2026-08-20T05:54:03.023Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aca10fb45429056478c921506d0381db","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:03.046Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-090bafaae2819d364892c813: start","job_status":"start","queue_duration_s":1.060201,"scheduling_latency_s":1.060223}1755gitlab # [ 370.325020] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:04.127Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"090bafaae2819d364892c813","created_at":"2026-08-20T05:54:03.023Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aca10fb45429056478c921506d0381db","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:03.046Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-090bafaae2819d364892c813: done: 0.020736 sec","job_status":"done","queue_duration_s":1.060201,"scheduling_latency_s":1.060223,"redis_calls":9,"redis_duration_s":0.001621,"redis_read_bytes":7,"redis_write_bytes":984,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000297,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001021,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000303,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013027,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020736,"completed_at":"2026-08-20T05:54:04.126Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000893,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1756gitlab # [ 370.366784] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:04.128Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"5af3e55bd392f4db761515f6","created_at":"2026-08-20T05:54:03.081Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c984d8bce85c62d17b0d3cb352b4daa5","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:03.105Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-5af3e55bd392f4db761515f6: start","job_status":"start","queue_duration_s":1.022865,"scheduling_latency_s":1.022884}1757gitlab # [ 370.381108] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:04.148Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"5af3e55bd392f4db761515f6","created_at":"2026-08-20T05:54:03.081Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c984d8bce85c62d17b0d3cb352b4daa5","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:03.105Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-5af3e55bd392f4db761515f6: done: 0.020608 sec","job_status":"done","queue_duration_s":1.022865,"scheduling_latency_s":1.022884,"redis_calls":9,"redis_duration_s":0.001287,"redis_read_bytes":7,"redis_write_bytes":1183,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00029,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000726,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000271,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012842,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.020608,"completed_at":"2026-08-20T05:54:04.148Z","load_balancing_strategy":"primary","db_duration_s":0.003156,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1758gitlab # [ 370.424714] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:04.150Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"07f0775bc7661e2c057d2b87","created_at":"2026-08-20T05:54:03.134Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f4eb3ffba636d3633a946ec30b338ce2","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:03.160Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-07f0775bc7661e2c057d2b87: start","job_status":"start","queue_duration_s":0.990033,"scheduling_latency_s":0.990051}1759gitlab # [ 370.439114] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/08/20:05:54:04 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 441760gitlab # [ 370.441691] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/08/20:05:54:04 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 201 "" "git/2.55.0" 851761gitlab # [ 370.444234] gitaly[925]: time="2026-08-20T05:54:04.350Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQNB9BX0J6TNJFX4E8NDQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=246 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:54:04.340" grpc.time_ms=10.281 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1762gitlab # Enumerating objects: 5, done.1763gitlab # [ 370.457716] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:04.172Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"07f0775bc7661e2c057d2b87","created_at":"2026-08-20T05:54:03.134Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f4eb3ffba636d3633a946ec30b338ce2","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:03.160Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-07f0775bc7661e2c057d2b87: done: 0.022127 sec","job_status":"done","queue_duration_s":0.990033,"scheduling_latency_s":0.990051,"redis_calls":11,"redis_duration_s":0.001753,"redis_read_bytes":9,"redis_write_bytes":1464,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000309,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000737,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000707,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014981,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0005925,"exclusive_lock_hold_duration_s":0.00314368,"duration_s":0.022127,"completed_at":"2026-08-20T05:54:04.172Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001945,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1764gitlab # Counting objects: 20% (1/5)[ 370.500826] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:04.174Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"238ebd3e2c5ae802451a86c4","created_at":"2026-08-20T05:54:03.203Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"047951d09438fd14f74871d7ef9a8488","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:03.228Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-238ebd3e2c5ae802451a86c4: start","job_status":"start","queue_duration_s":0.945533,"scheduling_latency_s":0.945553}1765gitlab # Counting objects: 40% (2/5)[ 370.515395] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:04.212Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"238ebd3e2c5ae802451a86c4","created_at":"2026-08-20T05:54:03.203Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"047951d09438fd14f74871d7ef9a8488","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:03.228Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-238ebd3e2c5ae802451a86c4: done: 0.038477 sec","job_status":"done","queue_duration_s":0.945533,"scheduling_latency_s":0.945553,"redis_calls":11,"redis_duration_s":0.001991,"redis_read_bytes":9,"redis_write_bytes":1518,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000428,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000769,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000794,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022794,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00056282,"exclusive_lock_hold_duration_s":0.01210078,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.038477,"completed_at":"2026-08-20T05:54:04.212Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011708,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1766gitlab # Counting objects: 60% (3/5)[ 370.560969] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:04.214Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"ac32411e29a21bd23a856432","created_at":"2026-08-20T05:54:03.251Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"36571920aaf6d41b3202d03e34ae80b0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:03.281Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-ac32411e29a21bd23a856432: start","job_status":"start","queue_duration_s":0.933217,"scheduling_latency_s":0.933238}1767gitlab # Counting objects: 80% (4/5)Counting objects: 100% (5/5)[ 370.575743] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:04.225Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1768gitlab # Counting objects: 100% (5/5), done.1769gitlab # Delta compression using up to 4 threads1770gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1771gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)[ 370.585614] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:04.231Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"ac32411e29a21bd23a856432","created_at":"2026-08-20T05:54:03.251Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"36571920aaf6d41b3202d03e34ae80b0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:03.281Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-ac32411e29a21bd23a856432: done: 0.01694 sec","job_status":"done","queue_duration_s":0.933217,"scheduling_latency_s":0.933238,"redis_calls":9,"redis_duration_s":0.001254,"redis_read_bytes":7,"redis_write_bytes":1105,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000274,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00072,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00026,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011409,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01694,"completed_at":"2026-08-20T05:54:04.231Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000343,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1772gitlab # Writing objects: 100% (3/3)[ 370.632365] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:04.232Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"5c65caa3b2148b9cbc94a980","created_at":"2026-08-20T05:54:03.327Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2143f23f9d0aa48f7baadc9f0a5672ef","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:03.363Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-5c65caa3b2148b9cbc94a980: start","job_status":"start","queue_duration_s":0.868999,"scheduling_latency_s":0.869018}1773gitlab # [ 370.647398] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:04.243Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1774gitlab # Writing objects: 100% (3/3), 273 bytes | 5.00 KiB/s, done.1775gitlab # [ 370.651466] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:04.248Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"5c65caa3b2148b9cbc94a980","created_at":"2026-08-20T05:54:03.327Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2143f23f9d0aa48f7baadc9f0a5672ef","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:03.363Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-5c65caa3b2148b9cbc94a980: done: 0.01621 sec","job_status":"done","queue_duration_s":0.868999,"scheduling_latency_s":0.869018,"redis_calls":9,"redis_duration_s":0.001241,"redis_read_bytes":7,"redis_write_bytes":1178,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000291,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000683,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000267,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011196,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01621,"completed_at":"2026-08-20T05:54:04.248Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000415,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1776gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1777gitlab # [ 370.695034] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:04.249Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"890d0152388e84f5bda10163","created_at":"2026-08-20T05:54:03.360Z","trace_propagation_headers":{"sentry-trace":"1e4f8821e47640e6b5b28930a1937efc-b196ec55c13b4ec9","baggage":"sentry-trace_id=1e4f8821e47640e6b5b28930a1937efc,sentry-release=Unknown"},"correlation_id":"01M0EVQF45DRQRAQTJN6RFD1RS","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:03.404Z","job_size_bytes":3,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-890d0152388e84f5bda10163: start","job_status":"start","queue_duration_s":0.845279,"scheduling_latency_s":0.845298}1778gitlab # [ 370.713150] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/08/20:05:54:04 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 12481779gitlab # [ 370.715795] nixbot[3752]: {"ts": "2026-08-20T05:54:04.574Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1780gitlab # [ 370.718460] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:04.351Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"890d0152388e84f5bda10163","created_at":"2026-08-20T05:54:03.360Z","trace_propagation_headers":{"sentry-trace":"1e4f8821e47640e6b5b28930a1937efc-b196ec55c13b4ec9","baggage":"sentry-trace_id=1e4f8821e47640e6b5b28930a1937efc,sentry-release=Unknown"},"correlation_id":"01M0EVQF45DRQRAQTJN6RFD1RS","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:03.404Z","job_size_bytes":3,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-890d0152388e84f5bda10163: done: 0.101114 sec","job_status":"done","queue_duration_s":0.845279,"scheduling_latency_s":0.845298,"redis_calls":11,"redis_duration_s":0.001884,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000287,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00124,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000357,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.01,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.076629,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00027076,"duration_s":0.101114,"completed_at":"2026-08-20T05:54:04.351Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019865,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1781gitlab # [ 370.763466] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:04.352Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"f89a021c2cfea323190eb37d","created_at":"2026-08-20T05:54:03.393Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5d0461d2a85e1d9cb874d028aca15895","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:03.428Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-f89a021c2cfea323190eb37d: start","job_status":"start","queue_duration_s":0.924443,"scheduling_latency_s":0.924468}1782gitlab # [ 370.778039] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:04.589Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"f89a021c2cfea323190eb37d","created_at":"2026-08-20T05:54:03.393Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5d0461d2a85e1d9cb874d028aca15895","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:03.428Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-f89a021c2cfea323190eb37d: done: 0.236877 sec","job_status":"done","queue_duration_s":0.924443,"scheduling_latency_s":0.924468,"redis_calls":13,"redis_duration_s":0.002777,"redis_read_bytes":11,"redis_write_bytes":1567,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000864,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001009,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000904,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.034,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.034,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.199489,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00056666,"exclusive_lock_hold_duration_s":0.21276108,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.236877,"completed_at":"2026-08-20T05:54:04.589Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.046239,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1783gitlab # [ 370.823800] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:04.591Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"3205b1d26cf4d8c327a1e202","created_at":"2026-08-20T05:54:03.485Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a9f5e86a30476700dae5362e80f86d1c","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:03.519Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-3205b1d26cf4d8c327a1e202: start","job_status":"start","queue_duration_s":1.072554,"scheduling_latency_s":1.072579}1784gitlab # [ 370.838180] nixbot[3752]: {"ts": "2026-08-20T05:54:04.649Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1785gitlab # [ 370.840351] nixbot[3752]: {"ts": "2026-08-20T05:54:04.725Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1786gitlab # [ 370.842516] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/08/20:05:54:04 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 641787gitlab # [ 370.844507] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/08/20:05:54:04 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 691788gitlab # [ 370.877204] gitaly[925]: time="2026-08-20T05:54:04.793Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQNSTWQJFGGEM8W2CYW78 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-08-20T05:54:34.084" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:54:04.785" grpc.time_ms=8.047 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1789gitlab # [ 370.898029] gitaly[925]: time="2026-08-20T05:54:04.814Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQNSTWQJFGGEM8W2CYW78 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:54:34.113" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:04.813" grpc.time_ms=0.706 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1790gitlab # [ 370.911838] gitaly[925]: time="2026-08-20T05:54:04.827Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQNSTWQJFGGEM8W2CYW78 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-20T05:54:14.258" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:04.818" grpc.time_ms=8.5 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1791gitlab # [ 370.998497] nixbot[3752]: {"ts": "2026-08-20T05:54:04.914Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1792gitlab # [ 371.001127] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/08/20:05:54:04 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 731 "" "python-httpx/0.28.1" 1861793gitlab # [ 371.049303] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:04.965Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"3205b1d26cf4d8c327a1e202","created_at":"2026-08-20T05:54:03.485Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a9f5e86a30476700dae5362e80f86d1c","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:03.519Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-3205b1d26cf4d8c327a1e202: done: 0.373435 sec","job_status":"done","queue_duration_s":1.072554,"scheduling_latency_s":1.072579,"redis_calls":564,"redis_duration_s":0.08670900000000001,"redis_read_bytes":562,"redis_write_bytes":49063,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000287,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000769,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.085653,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.319701,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.373435,"completed_at":"2026-08-20T05:54:04.964Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000449,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1794gitlab # [ 371.092804] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:04.966Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"d12a99c7c78038e92b05f135","created_at":"2026-08-20T05:54:03.536Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8a90ce236b18cd1f23998d48b21d15cc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T05:54:03.549Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-d12a99c7c78038e92b05f135: start","job_status":"start","queue_duration_s":1.417144,"scheduling_latency_s":1.417174}1795gitlab # [ 371.106333] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:04.980Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1796gitlab # [ 371.109682] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:04.987Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"d12a99c7c78038e92b05f135","created_at":"2026-08-20T05:54:03.536Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8a90ce236b18cd1f23998d48b21d15cc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T05:54:03.549Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-d12a99c7c78038e92b05f135: done: 0.02045 sec","job_status":"done","queue_duration_s":1.417144,"scheduling_latency_s":1.417174,"redis_calls":9,"redis_duration_s":0.0015,"redis_read_bytes":7,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000338,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000842,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00032,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013604,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02045,"completed_at":"2026-08-20T05:54:04.987Z","load_balancing_strategy":"primary","db_duration_s":0.000801,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1797gitlab # [ 371.151107] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:04.988Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"8d0b1ec518b1ffa1a7fb2104","created_at":"2026-08-20T05:54:03.574Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6a27804bef07dbc8f35294fbe0e70ca7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:03.591Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-8d0b1ec518b1ffa1a7fb2104: start","job_status":"start","queue_duration_s":1.397103,"scheduling_latency_s":1.397125}1798gitlab # [ 371.165844] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.012Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"8d0b1ec518b1ffa1a7fb2104","created_at":"2026-08-20T05:54:03.574Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6a27804bef07dbc8f35294fbe0e70ca7","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:03.591Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-8d0b1ec518b1ffa1a7fb2104: done: 0.024159 sec","job_status":"done","queue_duration_s":1.397103,"scheduling_latency_s":1.397125,"redis_calls":13,"redis_duration_s":0.002103,"redis_read_bytes":139,"redis_write_bytes":1306,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000492,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":392,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000922,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000689,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":296,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014678,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00028358,"extra.object_storage_delete_stale_direct_uploads_worker.total_pending_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.total_deleted_stale_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.execution_timeout":false,"duration_s":0.024159,"completed_at":"2026-08-20T05:54:05.012Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000849,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1799gitlab # [ 371.211938] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.014Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"a9a395ee48cc2ff51487bee1","created_at":"2026-08-20T05:54:03.612Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"41be6571d60c6f0ec7f63cbb81c3b220","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:03.623Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-a9a395ee48cc2ff51487bee1: start","job_status":"start","queue_duration_s":1.390719,"scheduling_latency_s":1.390758}1800gitlab # [ 371.225670] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.056Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"a9a395ee48cc2ff51487bee1","created_at":"2026-08-20T05:54:03.612Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"41be6571d60c6f0ec7f63cbb81c3b220","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:03.623Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-a9a395ee48cc2ff51487bee1: done: 0.042455 sec","job_status":"done","queue_duration_s":1.390719,"scheduling_latency_s":1.390758,"redis_calls":18,"redis_duration_s":0.0054930000000000005,"redis_read_bytes":20,"redis_write_bytes":4702,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001379,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000266,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.00285,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000998,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03025,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.042455,"completed_at":"2026-08-20T05:54:05.056Z","load_balancing_strategy":"primary","db_duration_s":0.003541,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1801gitlab # [ 371.269610] nixbot[3752]: {"ts": "2026-08-20T05:54:05.079Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1802gitlab # [ 371.272149] nixbot[3752]: {"ts": "2026-08-20T05:54:05.083Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1803gitlab # [ 371.274817] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/08/20:05:54:05 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1651804gitlab # [ 371.277303] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.059Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"99765563b9fa2965bc74b260","created_at":"2026-08-20T05:54:03.642Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"277c4f09c34a358b15f71222682be598","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:03.651Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-99765563b9fa2965bc74b260: start","job_status":"start","queue_duration_s":1.407623,"scheduling_latency_s":1.407645}1805gitlab # [ 371.291808] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.079Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1806gitlab # [ 371.295142] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.086Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"99765563b9fa2965bc74b260","created_at":"2026-08-20T05:54:03.642Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"277c4f09c34a358b15f71222682be598","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:03.651Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-99765563b9fa2965bc74b260: done: 0.027454 sec","job_status":"done","queue_duration_s":1.407623,"scheduling_latency_s":1.407645,"redis_calls":9,"redis_duration_s":0.004472,"redis_read_bytes":7,"redis_write_bytes":1112,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00036,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000951,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003161,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013627,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027454,"completed_at":"2026-08-20T05:54:05.086Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004233,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1807gitlab # [ 371.338377] gitaly[925]: time="2026-08-20T05:54:05.187Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=589 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=5 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQNP6QKCX3C1GZN0GTJ1Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-20T05:54:15.164" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=253 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:05.174" grpc.time_ms=12.067 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1808gitlab # [ 371.352350] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/08/20:05:54:05 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 831809gitlab # [ 371.354372] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.089Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"2c7ad5cf47d3f32eb8ec4a4e","created_at":"2026-08-20T05:54:03.662Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e9846f226d637a1b0dabdb54bf0d3aed","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:03.695Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-2c7ad5cf47d3f32eb8ec4a4e: start","job_status":"start","queue_duration_s":1.393335,"scheduling_latency_s":1.393359}1810gitlab # [ 371.369328] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.116Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"2c7ad5cf47d3f32eb8ec4a4e","created_at":"2026-08-20T05:54:03.662Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e9846f226d637a1b0dabdb54bf0d3aed","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:03.695Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-2c7ad5cf47d3f32eb8ec4a4e: done: 0.027953 sec","job_status":"done","queue_duration_s":1.393335,"scheduling_latency_s":1.393359,"redis_calls":11,"redis_duration_s":0.005849999999999999,"redis_read_bytes":9,"redis_write_bytes":1418,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000886,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002149,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002815,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016184,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00201258,"exclusive_lock_hold_duration_s":0.00278534,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.027953,"completed_at":"2026-08-20T05:54:05.116Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001199,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1811gitlab # [ 371.412958] gitaly[925]: time="2026-08-20T05:54:05.207Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=4 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQP642YA8T40P3REZ9AW1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:54:05.192" grpc.time_ms=14.95 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc1812gitlab # [ 371.426157] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.118Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"5860c89ff5ee24d67c3445ab","created_at":"2026-08-20T05:54:03.712Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"45ebad6812393cb97e3cb48a1af37376","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:03.729Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-5860c89ff5ee24d67c3445ab: start","job_status":"start","queue_duration_s":1.389514,"scheduling_latency_s":1.389536}1813gitlab # [ 371.441356] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.151Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"5860c89ff5ee24d67c3445ab","created_at":"2026-08-20T05:54:03.712Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"45ebad6812393cb97e3cb48a1af37376","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:03.729Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-5860c89ff5ee24d67c3445ab: done: 0.032806 sec","job_status":"done","queue_duration_s":1.389514,"scheduling_latency_s":1.389536,"redis_calls":11,"redis_duration_s":0.006887999999999999,"redis_read_bytes":9,"redis_write_bytes":1399,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001723,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004408,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000757,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018511,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00061306,"exclusive_lock_hold_duration_s":0.00510176,"duration_s":0.032806,"completed_at":"2026-08-20T05:54:05.151Z","load_balancing_strategy":"primary","db_duration_s":0.00301,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1814gitlab # [ 371.483503] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.154Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"db102263123c2f3436a650dd","created_at":"2026-08-20T05:54:03.746Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:03.766Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-db102263123c2f3436a650dd: start","job_status":"start","queue_duration_s":1.387202,"scheduling_latency_s":1.387225}1815gitlab # [ 371.497810] gitaly[925]: time="2026-08-20T05:54:05.267Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQNP6QKCX3C1GZN0GTJ1Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-20T05:54:35.054" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-20T05:54:05.254" grpc.time_ms=12.766 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1816gitlab # [ 371.512408] gitaly[925]: time="2026-08-20T05:54:05.295Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M0EVQNP6QKCX3C1GZN0GTJ1Q duration_ms=256ns method=POST pid=925 status=200 url="http://unix/api/v4/internal/allowed"1817gitlab # [ 371.515146] gitlab-workhorse[823]: time="2026-08-20T05:54:05Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1491818gitlab # [ 371.517108] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/08/20:05:54:05 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 149 "" "git/2.55.0" 1351819gitlab # [ 371.521569] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.299Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"db102263123c2f3436a650dd","created_at":"2026-08-20T05:54:03.746Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:03.766Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-db102263123c2f3436a650dd: done: 0.145008 sec","job_status":"done","queue_duration_s":1.387202,"scheduling_latency_s":1.387225,"redis_calls":70,"redis_duration_s":0.025957,"redis_read_bytes":118,"redis_write_bytes":42580,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.00368,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000598,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.020427,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001252,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.114057,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.145008,"completed_at":"2026-08-20T05:54:05.298Z","load_balancing_strategy":"primary","db_duration_s":0.002398,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1820gitlab # [ 371.565724] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.300Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"d713385c311dc4ab38e95185","created_at":"2026-08-20T05:54:03.792Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ad06786818d5c130d19a47c45b042b09","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:03.811Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-d713385c311dc4ab38e95185: start","job_status":"start","queue_duration_s":1.489228,"scheduling_latency_s":1.48926}1821gitlab # [ 371.580614] gitaly[925]: time="2026-08-20T05:54:05.345Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQP8XHEN1H37ZDBN5SZE5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:54:05.335" pid=925 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=149 span.kind=server system=grpc1822gitlab # [ 371.590751] gitlab-workhorse[823]: time="2026-08-20T05:54:05Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2231823gitlab # [ 371.592681] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/08/20:05:54:05 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 801824gitlab # [ 371.594540] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.321Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"d713385c311dc4ab38e95185","created_at":"2026-08-20T05:54:03.792Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ad06786818d5c130d19a47c45b042b09","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:03.811Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-d713385c311dc4ab38e95185: done: 0.021 sec","job_status":"done","queue_duration_s":1.489228,"scheduling_latency_s":1.48926,"redis_calls":9,"redis_duration_s":0.001538,"redis_read_bytes":7,"redis_write_bytes":1192,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000331,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000907,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0003,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012601,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021,"completed_at":"2026-08-20T05:54:05.321Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000986,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1825gitlab # [ 371.637549] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.323Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"7f97589f8123904e89498975","created_at":"2026-08-20T05:54:03.844Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bb009bd432149ff785f9fd0c2380c721","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:03.873Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-7f97589f8123904e89498975: start","job_status":"start","queue_duration_s":1.450149,"scheduling_latency_s":1.45017}1826gitlab # [ 371.654244] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.335Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1827gitlab # To http://gitlab/root/test-flake.git1828gitlab # [ 371.657665] gitaly[925]: time="2026-08-20T05:54:05.345Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQP8XHEN1H37ZDBN5SZE5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:54:05.335" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc1829gitlab # 42e3f64..b67f62f [ 371.671573] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/08/20:05:54:05 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 651830gitlab # master -> master[ 371.673990] gitlab-workhorse[823]: time="2026-08-20T05:54:05Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521831gitlab # 1832gitlab # [ 371.675902] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/08/20:05:54:05 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 9451833gitlab # [ 371.678076] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.341Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"7f97589f8123904e89498975","created_at":"2026-08-20T05:54:03.844Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bb009bd432149ff785f9fd0c2380c721","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:03.873Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-7f97589f8123904e89498975: done: 0.017983 sec","job_status":"done","queue_duration_s":1.450149,"scheduling_latency_s":1.45017,"redis_calls":9,"redis_duration_s":0.001429,"redis_read_bytes":7,"redis_write_bytes":1185,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000287,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000811,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000331,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012216,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017983,"completed_at":"2026-08-20T05:54:05.341Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000883,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1834gitlab # [ 371.718520] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.343Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"758173106661bb463afdaeec","created_at":"2026-08-20T05:54:03.897Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f2c7a27a533bdcf64fb6858ef9c8cdcc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T05:54:03.917Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-758173106661bb463afdaeec: start","job_status":"start","queue_duration_s":1.425855,"scheduling_latency_s":1.425875}1835gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 1.52 seconds)1836gitlab: must succeed: git -C /tmp/test-flake rev-parse master1837gitlab # [ 371.731440] gitaly[925]: time="2026-08-20T05:54:05.345Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQP8XHEN1H37ZDBN5SZE5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:54:05.335" grpc.time_ms=10.034 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc1838gitlab # [ 371.745582] gitaly[925]: time="2026-08-20T05:54:05.346Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M0EVQNP6QKCX3C1GZN0GTJ1Q duration_ms=49ns method=POST pid=925 status=200 url="http://unix/api/v4/internal/pre_receive"1839gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.03 seconds)1840gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d'1841gitlab # [ 371.748852] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.382Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"758173106661bb463afdaeec","created_at":"2026-08-20T05:54:03.897Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-369e8c8018e04fa4","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f2c7a27a533bdcf64fb6858ef9c8cdcc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T05:54:03.917Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-758173106661bb463afdaeec: done: 0.039635 sec","job_status":"done","queue_duration_s":1.425855,"scheduling_latency_s":1.425875,"redis_calls":9,"redis_duration_s":0.001762,"redis_read_bytes":7,"redis_write_bytes":1068,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000328,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001068,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000366,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021473,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.039635,"completed_at":"2026-08-20T05:54:05.382Z","load_balancing_strategy":"primary","db_duration_s":0.003335,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1842gitlab # [ 371.790260] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.384Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8eb0dc93c813ab07b1c8e46c","created_at":"2026-08-20T05:54:05.032Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-034fd3d93c7b49e7","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"41be6571d60c6f0ec7f63cbb81c3b220","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.049Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8eb0dc93c813ab07b1c8e46c: start","job_status":"start","queue_duration_s":0.334667,"scheduling_latency_s":0.33469}1843gitlab # [ 371.802872] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.406Z","message":"No existing merge request to be cleaned up."}1844gitlab # [ 371.805036] gitaly[925]: time="2026-08-20T05:54:05.346Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVQNP6QKCX3C1GZN0GTJ1Q grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5315 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:54:05.037" grpc.time_ms=309.058 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1845gitlab # [ 371.815414] gitaly[925]: time="2026-08-20T05:54:05.371Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVQNP6QKCX3C1GZN0GTJ1Q grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:54:05.370" grpc.time_ms=0.534 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1846gitlab # [ 371.825998] gitlab-workhorse[823]: time="2026-08-20T05:54:05Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671847gitlab # [ 371.827810] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/08/20:05:54:05 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1161848gitlab # [ 371.829832] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.418Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8eb0dc93c813ab07b1c8e46c","created_at":"2026-08-20T05:54:05.032Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-034fd3d93c7b49e7","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"41be6571d60c6f0ec7f63cbb81c3b220","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.049Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8eb0dc93c813ab07b1c8e46c: done: 0.034187 sec","job_status":"done","queue_duration_s":0.334667,"scheduling_latency_s":0.33469,"redis_calls":12,"redis_duration_s":0.00293,"redis_read_bytes":10,"redis_write_bytes":1323,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000453,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000808,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001669,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019834,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034187,"completed_at":"2026-08-20T05:54:05.418Z","load_balancing_strategy":"primary","db_duration_s":0.011699,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1849gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d', in 0.12 seconds)1850gitlab # [ 371.872688] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.420Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1b99f265299ba53db9c629c8","created_at":"2026-08-20T05:54:05.032Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-034fd3d93c7b49e7","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"41be6571d60c6f0ec7f63cbb81c3b220","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.049Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1b99f265299ba53db9c629c8: start","job_status":"start","queue_duration_s":0.370341,"scheduling_latency_s":0.370363}1851gitlab # [ 371.884816] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.433Z","message":"No existing merge request to be cleaned up."}1852gitlab # [ 371.886471] gitaly[925]: time="2026-08-20T05:54:05.407Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVQNP6QKCX3C1GZN0GTJ1Q grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4784 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:54:05.405" grpc.time_ms=1.215 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1853gitlab # [ 371.897046] gitaly[925]: time="2026-08-20T05:54:05.432Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQPD8P8HDSCYG8PRG8CKD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:54:05.411" pid=925 remote_ip="2001:db8:1::1" request_sha=396c9ee2fb79d55e33ad816aae1157af63f14ab6 response_bytes=223 span.kind=server system=grpc1854gitlab # [ 371.907579] nixbot[3752]: INFO: ::ffff:127.0.0.1:47704 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d HTTP/1.1" 200 OK1855gitlab # [ 371.909687] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.442Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1b99f265299ba53db9c629c8","created_at":"2026-08-20T05:54:05.032Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-034fd3d93c7b49e7","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"41be6571d60c6f0ec7f63cbb81c3b220","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.049Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1b99f265299ba53db9c629c8: done: 0.02258 sec","job_status":"done","queue_duration_s":0.370341,"scheduling_latency_s":0.370363,"redis_calls":10,"redis_duration_s":0.001534,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000647,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000887,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014918,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02258,"completed_at":"2026-08-20T05:54:05.442Z","load_balancing_strategy":"primary","db_duration_s":0.002591,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1856gitlab # [ 371.948655] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.443Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8e87ed7c148ccad884a5f708","created_at":"2026-08-20T05:54:05.032Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-034fd3d93c7b49e7","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"41be6571d60c6f0ec7f63cbb81c3b220","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.049Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8e87ed7c148ccad884a5f708: start","job_status":"start","queue_duration_s":0.394173,"scheduling_latency_s":0.394193}1857gitlab # [ 371.961994] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.460Z","message":"No existing merge request to be cleaned up."}1858gitlab # [ 371.963619] gitlab-workhorse[823]: time="2026-08-20T05:54:05Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=3431859gitlab # [ 371.965616] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/08/20:05:54:05 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 343 "" "git/2.55.0" 871860gitlab # [ 371.967487] gitaly[925]: time="2026-08-20T05:54:05.432Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1137 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=4 command.system_time_ms=0 command.user_time_ms=12 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQPD8P8HDSCYG8PRG8CKD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:54:05.411" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=2 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc1861gitlab # [ 371.981762] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.469Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8e87ed7c148ccad884a5f708","created_at":"2026-08-20T05:54:05.032Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-034fd3d93c7b49e7","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"41be6571d60c6f0ec7f63cbb81c3b220","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.049Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8e87ed7c148ccad884a5f708: done: 0.026043 sec","job_status":"done","queue_duration_s":0.394173,"scheduling_latency_s":0.394193,"redis_calls":10,"redis_duration_s":0.001976,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000931,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001045,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015861,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026043,"completed_at":"2026-08-20T05:54:05.469Z","load_balancing_strategy":"primary","db_duration_s":0.005334,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1862gitlab # [ 372.019967] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.471Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"26270221fb638c3f57a361b4","created_at":"2026-08-20T05:54:05.032Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-034fd3d93c7b49e7","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"41be6571d60c6f0ec7f63cbb81c3b220","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.049Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-26270221fb638c3f57a361b4: start","job_status":"start","queue_duration_s":0.421525,"scheduling_latency_s":0.421546}1863gitlab # [ 372.032375] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.483Z","message":"No existing merge request to be cleaned up."}1864gitlab # [ 372.033994] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/08/20:05:54:05 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 751865gitlab # [ 372.036056] gitaly[925]: time="2026-08-20T05:54:05.432Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1137 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=4 command.system_time_ms=0 command.user_time_ms=12 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQPD8P8HDSCYG8PRG8CKD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:54:05.411" grpc.time_ms=21.149 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=2 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc1866gitlab # [ 372.050664] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.494Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"26270221fb638c3f57a361b4","created_at":"2026-08-20T05:54:05.032Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-034fd3d93c7b49e7","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"41be6571d60c6f0ec7f63cbb81c3b220","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.049Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-26270221fb638c3f57a361b4: done: 0.023403 sec","job_status":"done","queue_duration_s":0.421525,"scheduling_latency_s":0.421546,"redis_calls":10,"redis_duration_s":0.00154,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000676,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000864,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014726,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023403,"completed_at":"2026-08-20T05:54:05.494Z","load_balancing_strategy":"primary","db_duration_s":0.003734,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1867gitlab # [ 372.091609] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.496Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2e923564662d99816ace61d2","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2e923564662d99816ace61d2: start","job_status":"start","queue_duration_s":0.206212,"scheduling_latency_s":0.206236}1868gitlab # [ 372.103902] gitaly[925]: time="2026-08-20T05:54:05.446Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVQNP6QKCX3C1GZN0GTJ1Q grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:54:05.444" grpc.time_ms=1.923 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1869gitlab # [ 372.114691] gitaly[925]: time="2026-08-20T05:54:05.543Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M0EVQNP6QKCX3C1GZN0GTJ1Q duration_ms=70ns method=POST pid=925 status=200 url="http://unix/api/v4/internal/post_receive"1870gitlab # [ 372.117632] gitlab-workhorse[823]: time="2026-08-20T05:54:05Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2091871gitlab # [ 372.119448] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/08/20:05:54:05 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 951872gitlab # [ 372.121424] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.523Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2e923564662d99816ace61d2","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2e923564662d99816ace61d2: done: 0.027525 sec","job_status":"done","queue_duration_s":0.206212,"scheduling_latency_s":0.206236,"redis_calls":15,"redis_duration_s":0.002737,"redis_read_bytes":12,"redis_write_bytes":1464,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000354,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000743,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00164,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017181,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027525,"completed_at":"2026-08-20T05:54:05.523Z","load_balancing_strategy":"primary","db_duration_s":0.000505,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1873gitlab # [ 372.162135] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.525Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d25f49b36462907a6ee3da74","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d25f49b36462907a6ee3da74: start","job_status":"start","queue_duration_s":0.235997,"scheduling_latency_s":0.236026}1874gitlab # [ 372.174569] gitaly[925]: time="2026-08-20T05:54:05.543Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=6 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQPH53E71KJR0GRTQV3NR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:54:05.531" grpc.time_ms=11.975 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc1875gitlab # [ 372.187747] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.546Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d25f49b36462907a6ee3da74","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d25f49b36462907a6ee3da74: done: 0.020372 sec","job_status":"done","queue_duration_s":0.235997,"scheduling_latency_s":0.236026,"redis_calls":13,"redis_duration_s":0.001942,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000699,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001243,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013848,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020372,"completed_at":"2026-08-20T05:54:05.546Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1876gitlab # [ 372.227069] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.549Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"128b394f0b44dec48566ca16","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-128b394f0b44dec48566ca16: start","job_status":"start","queue_duration_s":0.25987,"scheduling_latency_s":0.259899}1877gitlab # [ 372.240062] gitaly[925]: time="2026-08-20T05:54:05.544Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVQNP6QKCX3C1GZN0GTJ1Q grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4809 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:54:05.470" grpc.time_ms=74.303 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1878gitlab # [ 372.250347] gitaly[925]: time="2026-08-20T05:54:05.559Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M0EVQNP6QKCX3C1GZN0GTJ1Q diskcache=5ca60244-5be0-4221-8138-b28f8933d813 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:54:04.929" pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1879gitlab # [ 372.261864] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.566Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"128b394f0b44dec48566ca16","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-128b394f0b44dec48566ca16: done: 0.017104 sec","job_status":"done","queue_duration_s":0.25987,"scheduling_latency_s":0.259899,"redis_calls":13,"redis_duration_s":0.001577,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00058,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000997,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011103,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017104,"completed_at":"2026-08-20T05:54:05.566Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1880gitlab # [ 372.300919] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.568Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e3bfaaf4a8febcf083de0fb","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e3bfaaf4a8febcf083de0fb: start","job_status":"start","queue_duration_s":0.278372,"scheduling_latency_s":0.278399}1881gitlab # [ 372.312963] gitaly[925]: time="2026-08-20T05:54:05.559Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=169 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=851968 command.minflt=12907 command.oublock=32 command.real_time_ms=620 command.spawn_token_fork_ms=1 command.system_time_ms=93 command.user_time_ms=76 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQNP6QKCX3C1GZN0GTJ1Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:54:04.929" grpc.time_ms=629.67 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1882gitlab # [ 372.326326] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.585Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e3bfaaf4a8febcf083de0fb","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e3bfaaf4a8febcf083de0fb: done: 0.016869 sec","job_status":"done","queue_duration_s":0.278372,"scheduling_latency_s":0.278399,"redis_calls":13,"redis_duration_s":0.001693,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000642,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001051,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011133,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016869,"completed_at":"2026-08-20T05:54:05.585Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1883gitlab # [ 372.365426] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.586Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42af050a79a9da9ab54f08ab","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42af050a79a9da9ab54f08ab: start","job_status":"start","queue_duration_s":0.296753,"scheduling_latency_s":0.296781}1884gitlab # [ 372.377777] gitaly[925]: time="2026-08-20T05:54:05.660Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQPKAK13R1TQ6BS8RWM24 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:54:05.647" pid=925 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc1885gitlab # [ 372.388117] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.603Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42af050a79a9da9ab54f08ab","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42af050a79a9da9ab54f08ab: done: 0.016887 sec","job_status":"done","queue_duration_s":0.296753,"scheduling_latency_s":0.296781,"redis_calls":13,"redis_duration_s":0.001676,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000615,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001061,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011105,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016887,"completed_at":"2026-08-20T05:54:05.603Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1886gitlab # [ 372.426638] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.605Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cb96800f476224ae6891eabb","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cb96800f476224ae6891eabb: start","job_status":"start","queue_duration_s":0.315168,"scheduling_latency_s":0.315199}1887gitlab # [ 372.439139] gitaly[925]: time="2026-08-20T05:54:05.661Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQPKAK13R1TQ6BS8RWM24 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:54:05.647" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc1888gitlab # [ 372.453021] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.623Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cb96800f476224ae6891eabb","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cb96800f476224ae6891eabb: done: 0.018885 sec","job_status":"done","queue_duration_s":0.315168,"scheduling_latency_s":0.315199,"redis_calls":13,"redis_duration_s":0.003411,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000915,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002496,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011544,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018885,"completed_at":"2026-08-20T05:54:05.623Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1889gitlab # [ 372.492886] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.626Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c9d1bdbeea70351a7b07e69f","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c9d1bdbeea70351a7b07e69f: start","job_status":"start","queue_duration_s":0.336335,"scheduling_latency_s":0.33637}1890gitlab # [ 372.505498] gitaly[925]: time="2026-08-20T05:54:05.661Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQPKAK13R1TQ6BS8RWM24 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:54:05.647" grpc.time_ms=13.934 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc1891gitlab # [ 372.520463] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.647Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c9d1bdbeea70351a7b07e69f","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c9d1bdbeea70351a7b07e69f: done: 0.021729 sec","job_status":"done","queue_duration_s":0.336335,"scheduling_latency_s":0.33637,"redis_calls":13,"redis_duration_s":0.005098,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002215,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002883,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011906,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021729,"completed_at":"2026-08-20T05:54:05.647Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1892gitlab # [ 372.559395] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.649Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c555e259b2e5ed673e3fd57","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c555e259b2e5ed673e3fd57: start","job_status":"start","queue_duration_s":0.359605,"scheduling_latency_s":0.359634}1893gitlab # [ 372.571820] gitaly[925]: time="2026-08-20T05:54:05.752Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQPQ2N8K28YBHNE8ZS44Q grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:54:05.736" pid=925 remote_ip="2001:db8:1::1" request_sha=81eb531a268a55974c5752c74095f01069515325 response_bytes=343 span.kind=server system=grpc1894gitlab # [ 372.582518] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.668Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c555e259b2e5ed673e3fd57","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c555e259b2e5ed673e3fd57: done: 0.018524 sec","job_status":"done","queue_duration_s":0.359605,"scheduling_latency_s":0.359634,"redis_calls":13,"redis_duration_s":0.001809,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000729,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00108,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012382,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018524,"completed_at":"2026-08-20T05:54:05.667Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1895gitlab # [ 372.622594] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.669Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b25914fa7a07432a5fc04f4c","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b25914fa7a07432a5fc04f4c: start","job_status":"start","queue_duration_s":0.379894,"scheduling_latency_s":0.379922}1896gitlab # [ 372.635261] gitaly[925]: time="2026-08-20T05:54:05.752Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1129 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQPQ2N8K28YBHNE8ZS44Q grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:54:05.736" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc1897gitlab # [ 372.649249] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.686Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b25914fa7a07432a5fc04f4c","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b25914fa7a07432a5fc04f4c: done: 0.016804 sec","job_status":"done","queue_duration_s":0.379894,"scheduling_latency_s":0.379922,"redis_calls":13,"redis_duration_s":0.001618,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000674,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000944,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011101,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016804,"completed_at":"2026-08-20T05:54:05.686Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1898gitlab # [ 372.689707] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.688Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a929913df9e8d58210785dee","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a929913df9e8d58210785dee: start","job_status":"start","queue_duration_s":0.398194,"scheduling_latency_s":0.398223}1899gitlab # [ 372.702265] gitaly[925]: time="2026-08-20T05:54:05.753Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1129 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQPQ2N8K28YBHNE8ZS44Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:54:05.736" grpc.time_ms=16.251 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc1900gitlab # [ 372.717849] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.705Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a929913df9e8d58210785dee","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a929913df9e8d58210785dee: done: 0.017438 sec","job_status":"done","queue_duration_s":0.398194,"scheduling_latency_s":0.398223,"redis_calls":13,"redis_duration_s":0.0017139999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00063,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001084,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01177,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017438,"completed_at":"2026-08-20T05:54:05.705Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1901gitlab # [ 372.759137] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.706Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ab2fad44e5ba8a815c33aa1","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ab2fad44e5ba8a815c33aa1: start","job_status":"start","queue_duration_s":0.417031,"scheduling_latency_s":0.41706}1902gitlab # [ 372.771752] gitaly[925]: time="2026-08-20T05:54:05.880Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQPVD5YXEM93RRD11YJNJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:54:05.869" grpc.time_ms=10.843 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc1903gitlab # [ 372.785096] gitaly[925]: time="2026-08-20T05:54:05.978Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQPXW6C4EB276MF5JZM3Z grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:54:05.952" pid=925 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc1904gitlab # [ 372.795188] nixbot[3752]: {"ts": "2026-08-20T05:54:06.682Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/42e3f64711217c5a5b26574a2bedc4bb007a4058 \"HTTP/1.1 201 Created\""}1905gitlab # [ 372.798060] nixbot[3752]: {"ts": "2026-08-20T05:54:06.693Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-42e3f6471121-0"}1906gitlab # [ 372.800402] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.724Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ab2fad44e5ba8a815c33aa1","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ab2fad44e5ba8a815c33aa1: done: 0.017406 sec","job_status":"done","queue_duration_s":0.417031,"scheduling_latency_s":0.41706,"redis_calls":14,"redis_duration_s":0.0023,"redis_read_bytes":138,"redis_write_bytes":1237,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.00013,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":80,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000739,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001431,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011335,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017406,"completed_at":"2026-08-20T05:54:05.724Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1907gitlab # [ 372.841084] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.726Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f478704d3d24efefc34719aa","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f478704d3d24efefc34719aa: start","job_status":"start","queue_duration_s":0.436469,"scheduling_latency_s":0.436495}1908gitlab # [ 372.853939] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/08/20:05:54:06 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/42e3f64711217c5a5b26574a2bedc4bb007a4058 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 6521909gitlab # [ 372.856461] gitaly[925]: time="2026-08-20T05:54:05.978Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1101 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=4 command.system_time_ms=13 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQPXW6C4EB276MF5JZM3Z grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:54:05.952" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc1910gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d'1911gitlab # [ 372.870182] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.743Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f478704d3d24efefc34719aa","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f478704d3d24efefc34719aa: done: 0.017103 sec","job_status":"done","queue_duration_s":0.436469,"scheduling_latency_s":0.436495,"redis_calls":13,"redis_duration_s":0.001679,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000626,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001053,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011262,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017103,"completed_at":"2026-08-20T05:54:05.743Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1912gitlab # [ 372.909576] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.745Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a2a637aab2c50a22314ab78","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a2a637aab2c50a22314ab78: start","job_status":"start","queue_duration_s":0.455333,"scheduling_latency_s":0.455363}1913gitlab # [ 372.921475] systemd[1]: Started Nix Daemon.1914gitlab # [ 372.922102] gitaly[925]: time="2026-08-20T05:54:05.986Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1101 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=4 command.system_time_ms=13 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQPXW6C4EB276MF5JZM3Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:54:05.952" grpc.time_ms=26.724 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc1915gitlab # [ 372.937472] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.763Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1a2a637aab2c50a22314ab78","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1a2a637aab2c50a22314ab78: done: 0.017842 sec","job_status":"done","queue_duration_s":0.455333,"scheduling_latency_s":0.455363,"redis_calls":13,"redis_duration_s":0.002255,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001115,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00114,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017842,"completed_at":"2026-08-20T05:54:05.762Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1916gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d', in 0.10 seconds)1917gitlab # [ 372.978236] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.764Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7cd407c81729899d94f57d19","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7cd407c81729899d94f57d19: start","job_status":"start","queue_duration_s":0.474587,"scheduling_latency_s":0.474616}1918gitlab # [ 372.990682] gitaly[925]: time="2026-08-20T05:54:06.100Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQQ2BV4G2QVT8F1K95CTZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:54:36.096" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:06.097" grpc.time_ms=2.333 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1919gitlab # [ 373.003612] nixbot[3752]: INFO: ::ffff:127.0.0.1:47710 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d HTTP/1.1" 200 OK1920gitlab # [ 373.005702] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.781Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7cd407c81729899d94f57d19","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7cd407c81729899d94f57d19: done: 0.017393 sec","job_status":"done","queue_duration_s":0.474587,"scheduling_latency_s":0.474616,"redis_calls":13,"redis_duration_s":0.001907,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000637,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00127,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011595,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017393,"completed_at":"2026-08-20T05:54:05.781Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1921gitlab # [ 373.045326] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.783Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be31598d68c7bba7db71c2ff","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be31598d68c7bba7db71c2ff: start","job_status":"start","queue_duration_s":0.493673,"scheduling_latency_s":0.4937}1922gitlab # [ 373.057893] gitaly[925]: time="2026-08-20T05:54:06.180Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=589 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQQ2BV4G2QVT8F1K95CTZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-20T05:54:36.160" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:54:06.160" grpc.time_ms=19.953 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1923gitlab # [ 373.072107] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.801Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be31598d68c7bba7db71c2ff","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be31598d68c7bba7db71c2ff: done: 0.017478 sec","job_status":"done","queue_duration_s":0.493673,"scheduling_latency_s":0.4937,"redis_calls":13,"redis_duration_s":0.001731,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000605,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001126,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011603,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017478,"completed_at":"2026-08-20T05:54:05.800Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1924gitlab # [ 373.112925] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.802Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91eb25d5fe59ff65b53af613","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91eb25d5fe59ff65b53af613: start","job_status":"start","queue_duration_s":0.512272,"scheduling_latency_s":0.51229}1925gitlab # [ 373.126496] gitaly[925]: time="2026-08-20T05:54:06.211Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQQ2BV4G2QVT8F1K95CTZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:54:16.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:54:06.194" grpc.time_ms=16.607 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1926gitlab # [ 373.141234] nix-daemon[4046]: accepted connection from pid 4040, user nixbot1927gitlab # [ 373.142341] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.817Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91eb25d5fe59ff65b53af613","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91eb25d5fe59ff65b53af613: done: 0.015132 sec","job_status":"done","queue_duration_s":0.512272,"scheduling_latency_s":0.51229,"redis_calls":13,"redis_duration_s":0.0015019999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000547,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000955,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010307,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015132,"completed_at":"2026-08-20T05:54:05.817Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1928gitlab # [ 373.181761] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.818Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6608d6921adbc2b9f7b82827","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6608d6921adbc2b9f7b82827: start","job_status":"start","queue_duration_s":0.528582,"scheduling_latency_s":0.5286}1929gitlab # [ 373.194163] gitaly[925]: time="2026-08-20T05:54:06.308Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQQ2BV4G2QVT8F1K95CTZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T05:54:16.117" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:54:06.307" grpc.time_ms=0.543 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1930gitlab # [ 373.205159] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.834Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6608d6921adbc2b9f7b82827","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6608d6921adbc2b9f7b82827: done: 0.015922 sec","job_status":"done","queue_duration_s":0.528582,"scheduling_latency_s":0.5286,"redis_calls":13,"redis_duration_s":0.0015930000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000568,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001025,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010761,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015922,"completed_at":"2026-08-20T05:54:05.834Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1931gitlab # [ 373.244910] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.835Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7dd01256de497d04757a1263","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7dd01256de497d04757a1263: start","job_status":"start","queue_duration_s":0.545721,"scheduling_latency_s":0.545739}1932gitlab # [ 373.257248] gitaly[925]: time="2026-08-20T05:54:06.336Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQQ2BV4G2QVT8F1K95CTZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T05:54:16.128" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:54:06.318" grpc.time_ms=17.382 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1933gitlab # [ 373.270406] gitaly[925]: time="2026-08-20T05:54:06.387Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVQQ2BV4G2QVT8F1K95CTZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4153 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:54:06.386" grpc.time_ms=0.904 pid=925 span.kind=server system=grpc1934gitlab # [ 373.280152] nixbot[3752]: {"ts": "2026-08-20T05:54:07.169Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-42e3f6471121-0", "argv0": "bwrap"}1935gitlab # [ 373.282817] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.851Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7dd01256de497d04757a1263","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7dd01256de497d04757a1263: done: 0.015705 sec","job_status":"done","queue_duration_s":0.545721,"scheduling_latency_s":0.545739,"redis_calls":13,"redis_duration_s":0.001695,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000658,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001037,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010603,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015705,"completed_at":"2026-08-20T05:54:05.851Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1936gitlab # [ 373.324558] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.852Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"21398349dfe1e141737dfd54","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-21398349dfe1e141737dfd54: start","job_status":"start","queue_duration_s":0.562634,"scheduling_latency_s":0.562652}1937gitlab # [ 373.336925] nix-daemon[4046]: accepted connection from pid 4057, user nixbot1938gitlab # [ 373.337875] gitaly[925]: time="2026-08-20T05:54:06.415Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVQQ2BV4G2QVT8F1K95CTZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:54:06.412" grpc.time_ms=2.483 pid=925 span.kind=server system=grpc1939gitlab # [ 373.347742] gitaly[925]: time="2026-08-20T05:54:06.424Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQQ2BV4G2QVT8F1K95CTZ diskcache=b8a0df25-a2b5-4343-8c0f-0108c25db563 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T05:54:16.148" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:54:06.339" pid=925 ref=refs/keep-around/42e3f64711217c5a5b26574a2bedc4bb007a4058 remote_ip="2001:db8:1::1" revision=42e3f64711217c5a5b26574a2bedc4bb007a4058 span.kind=server system=grpc username=root1940gitlab # [ 373.359543] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.871Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"21398349dfe1e141737dfd54","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-21398349dfe1e141737dfd54: done: 0.018754 sec","job_status":"done","queue_duration_s":0.562634,"scheduling_latency_s":0.562652,"redis_calls":13,"redis_duration_s":0.00447,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001177,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003293,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01104,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018754,"completed_at":"2026-08-20T05:54:05.871Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1941gitlab # [ 373.399724] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.873Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ccc154997bd421dcc213cafa","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ccc154997bd421dcc213cafa: start","job_status":"start","queue_duration_s":0.583876,"scheduling_latency_s":0.5839}1942gitlab # [ 373.412447] gitaly[925]: time="2026-08-20T05:54:06.425Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=78 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5439 command.oublock=8 command.real_time_ms=79 command.spawn_token_fork_ms=2 command.system_time_ms=46 command.user_time_ms=32 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQQ2BV4G2QVT8F1K95CTZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T05:54:16.148" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:54:06.339" grpc.time_ms=85.661 pid=925 ref=refs/keep-around/42e3f64711217c5a5b26574a2bedc4bb007a4058 remote_ip="2001:db8:1::1" revision=42e3f64711217c5a5b26574a2bedc4bb007a4058 span.kind=server system=grpc username=root1943gitlab # [ 373.427254] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.899Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ccc154997bd421dcc213cafa","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ccc154997bd421dcc213cafa: done: 0.025597 sec","job_status":"done","queue_duration_s":0.583876,"scheduling_latency_s":0.5839,"redis_calls":13,"redis_duration_s":0.008269,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001363,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006906,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01373,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025597,"completed_at":"2026-08-20T05:54:05.899Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1944gitlab # [ 373.468196] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.900Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"15cb7d2069d983580f918a97","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-15cb7d2069d983580f918a97: start","job_status":"start","queue_duration_s":0.610891,"scheduling_latency_s":0.610913}1945gitlab # [ 373.481057] gitaly[925]: time="2026-08-20T05:54:06.431Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQQ2BV4G2QVT8F1K95CTZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:54:36.430" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:06.431" grpc.time_ms=0.504 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1946gitlab # [ 373.494997] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.918Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"15cb7d2069d983580f918a97","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-15cb7d2069d983580f918a97: done: 0.017383 sec","job_status":"done","queue_duration_s":0.610891,"scheduling_latency_s":0.610913,"redis_calls":13,"redis_duration_s":0.00197,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000652,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001318,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011735,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017383,"completed_at":"2026-08-20T05:54:05.918Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1947gitlab # [ 373.535171] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.919Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"44a9d16688ed0412d29c4852","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-44a9d16688ed0412d29c4852: start","job_status":"start","queue_duration_s":0.629543,"scheduling_latency_s":0.629561}1948gitlab # [ 373.548614] gitaly[925]: time="2026-08-20T05:54:06.500Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQNP6QKCX3C1GZN0GTJ1Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:54:16.061" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:54:06.491" grpc.time_ms=8.93 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1949gitlab # [ 373.561797] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.934Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"44a9d16688ed0412d29c4852","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-44a9d16688ed0412d29c4852: done: 0.015529 sec","job_status":"done","queue_duration_s":0.629543,"scheduling_latency_s":0.629561,"redis_calls":13,"redis_duration_s":0.001438,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010458,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015529,"completed_at":"2026-08-20T05:54:05.934Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1950gitlab # [ 373.601287] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.938Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac987718beb5c85297fcff33","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac987718beb5c85297fcff33: start","job_status":"start","queue_duration_s":0.648607,"scheduling_latency_s":0.648628}1951gitlab # [ 373.613847] gitaly[925]: time="2026-08-20T05:54:06.514Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQNP6QKCX3C1GZN0GTJ1Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:54:16.075" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:54:06.506" grpc.time_ms=7.462 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1952gitlab # [ 373.627135] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.955Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac987718beb5c85297fcff33","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac987718beb5c85297fcff33: done: 0.017023 sec","job_status":"done","queue_duration_s":0.648607,"scheduling_latency_s":0.648628,"redis_calls":13,"redis_duration_s":0.0015569999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000561,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000996,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010551,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017023,"completed_at":"2026-08-20T05:54:05.955Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1953gitlab # [ 373.667745] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.957Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af2cc946ddce25b5ce8d4552","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af2cc946ddce25b5ce8d4552: start","job_status":"start","queue_duration_s":0.667525,"scheduling_latency_s":0.667564}1954gitlab # [ 373.681070] gitaly[925]: time="2026-08-20T05:54:06.541Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQNP6QKCX3C1GZN0GTJ1Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-20T05:54:16.102" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:54:06.533" grpc.time_ms=7.874 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1955gitlab # [ 373.696244] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.974Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af2cc946ddce25b5ce8d4552","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af2cc946ddce25b5ce8d4552: done: 0.017397 sec","job_status":"done","queue_duration_s":0.667525,"scheduling_latency_s":0.667564,"redis_calls":13,"redis_duration_s":0.001582,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00057,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001012,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011321,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017397,"completed_at":"2026-08-20T05:54:05.974Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1956gitlab # [ 373.736424] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.976Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ba6511a65217605032ab82d2","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ba6511a65217605032ab82d2: start","job_status":"start","queue_duration_s":0.686235,"scheduling_latency_s":0.686261}1957gitlab # [ 373.749251] gitaly[925]: time="2026-08-20T05:54:06.558Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQNP6QKCX3C1GZN0GTJ1Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-08-20T05:54:36.547" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:06.548" grpc.time_ms=10.218 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1958gitlab # [ 373.765569] nix-daemon[4046]: accepted connection from pid 4074, user nixbot1959gitlab # [ 373.766527] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.993Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ba6511a65217605032ab82d2","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ba6511a65217605032ab82d2: done: 0.017426 sec","job_status":"done","queue_duration_s":0.686235,"scheduling_latency_s":0.686261,"redis_calls":13,"redis_duration_s":0.001849,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000744,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001105,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011695,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017426,"completed_at":"2026-08-20T05:54:05.993Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1960gitlab # [ 373.806780] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:05.998Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ad77806326ce3d9868df7cb","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ad77806326ce3d9868df7cb: start","job_status":"start","queue_duration_s":0.708894,"scheduling_latency_s":0.708934}1961gitlab # [ 373.819689] gitaly[925]: time="2026-08-20T05:54:06.577Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=318 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQNP6QKCX3C1GZN0GTJ1Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-20T05:54:16.139" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-08-20T05:54:06.569" grpc.time_ms=7.296 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1962gitlab # [ 373.833677] nix-daemon[4046]: accepted connection from pid 4084, user nixbot1963gitlab # [ 373.834638] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.018Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ad77806326ce3d9868df7cb","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ad77806326ce3d9868df7cb: done: 0.020247 sec","job_status":"done","queue_duration_s":0.708894,"scheduling_latency_s":0.708934,"redis_calls":13,"redis_duration_s":0.003831,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001279,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002552,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012507,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020247,"completed_at":"2026-08-20T05:54:06.018Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1964gitlab # [ 373.875140] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.020Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0b90d4e3f00a36f6bbf298a4","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0b90d4e3f00a36f6bbf298a4: start","job_status":"start","queue_duration_s":0.730423,"scheduling_latency_s":0.730449}1965gitlab # [ 373.888128] gitaly[925]: time="2026-08-20T05:54:06.597Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQNP6QKCX3C1GZN0GTJ1Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:54:16.158" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:54:06.589" grpc.time_ms=8.332 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1966gitlab # [ 373.903307] nix-daemon[4046]: accepted connection from pid 4091, user nixbot1967gitlab # [ 373.904333] nix-daemon[4046]: accepted connection from pid 4074, user nixbot1968gitlab # [ 373.905313] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.043Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0b90d4e3f00a36f6bbf298a4","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0b90d4e3f00a36f6bbf298a4: done: 0.022886 sec","job_status":"done","queue_duration_s":0.730423,"scheduling_latency_s":0.730449,"redis_calls":13,"redis_duration_s":0.005709,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001536,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004173,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013804,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022886,"completed_at":"2026-08-20T05:54:06.043Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1969gitlab # [ 373.945716] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.045Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ffe110de687b56be65af053","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ffe110de687b56be65af053: start","job_status":"start","queue_duration_s":0.755319,"scheduling_latency_s":0.755348}1970gitlab # [ 373.958512] gitaly[925]: time="2026-08-20T05:54:07.001Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQNP6QKCX3C1GZN0GTJ1Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-20T05:54:16.137" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:06.998" grpc.time_ms=2.98 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1971gitlab # [ 373.971490] gitaly[925]: time="2026-08-20T05:54:07.360Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQNP6QKCX3C1GZN0GTJ1Q diskcache=a6cd05f4-0526-4951-ba3a-0aa12113e016 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T11:54:07.310" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:07.311" pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1972gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d'1973gitlab # [ 373.981995] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.067Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ffe110de687b56be65af053","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ffe110de687b56be65af053: done: 0.022767 sec","job_status":"done","queue_duration_s":0.755319,"scheduling_latency_s":0.755348,"redis_calls":13,"redis_duration_s":0.007407,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002158,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005249,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010923,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022767,"completed_at":"2026-08-20T05:54:06.067Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1974gitlab # [ 374.019135] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.069Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"16c6bbc0e5148236a576b35d","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-16c6bbc0e5148236a576b35d: start","job_status":"start","queue_duration_s":0.779876,"scheduling_latency_s":0.779894}1975gitlab # [ 374.032095] gitaly[925]: time="2026-08-20T05:54:07.361Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=5 command.cpu_time_ms=33 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1508 command.oublock=0 command.real_time_ms=63 command.spawn_token_fork_ms=5 command.system_time_ms=30 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQNP6QKCX3C1GZN0GTJ1Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T11:54:07.310" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:07.311" grpc.time_ms=49.863 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1976gitlab # [ 374.047898] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.089Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"16c6bbc0e5148236a576b35d","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-16c6bbc0e5148236a576b35d: done: 0.020217 sec","job_status":"done","queue_duration_s":0.779876,"scheduling_latency_s":0.779894,"redis_calls":13,"redis_duration_s":0.006948,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004074,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002874,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01028,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020217,"completed_at":"2026-08-20T05:54:06.089Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1977gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d', in 0.11 seconds)1978gitlab # [ 374.087267] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.091Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"885153829f4753b63d3e253e","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-885153829f4753b63d3e253e: start","job_status":"start","queue_duration_s":0.801169,"scheduling_latency_s":0.801185}1979gitlab # [ 374.099453] gitaly[925]: time="2026-08-20T05:54:07.711Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQQ2BV4G2QVT8F1K95CTZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T05:54:37.708" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:07.708" grpc.time_ms=2.148 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1980gitlab # [ 374.113785] nixbot[3752]: INFO: ::ffff:127.0.0.1:47718 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d HTTP/1.1" 200 OK1981gitlab # [ 374.115688] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.107Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"885153829f4753b63d3e253e","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-885153829f4753b63d3e253e: done: 0.015938 sec","job_status":"done","queue_duration_s":0.801169,"scheduling_latency_s":0.801185,"redis_calls":13,"redis_duration_s":0.002641,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000611,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00203,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010092,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015938,"completed_at":"2026-08-20T05:54:06.106Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1982gitlab # [ 374.155093] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.109Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8fe16c9a949adfd187fa7d0c","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8fe16c9a949adfd187fa7d0c: start","job_status":"start","queue_duration_s":0.819404,"scheduling_latency_s":0.819421}1983gitlab # [ 374.167584] gitaly[925]: time="2026-08-20T05:54:07.810Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQQ2BV4G2QVT8F1K95CTZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:54:37.807" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:07.808" grpc.time_ms=1.716 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1984gitlab # [ 374.179956] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.124Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8fe16c9a949adfd187fa7d0c","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8fe16c9a949adfd187fa7d0c: done: 0.015449 sec","job_status":"done","queue_duration_s":0.819404,"scheduling_latency_s":0.819421,"redis_calls":13,"redis_duration_s":0.0015600000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00059,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00097,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010648,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015449,"completed_at":"2026-08-20T05:54:06.124Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1985gitlab # [ 374.219218] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.125Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bef47a9667d0e7e246f7f1dc","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bef47a9667d0e7e246f7f1dc: start","job_status":"start","queue_duration_s":0.836071,"scheduling_latency_s":0.836088}1986gitlab # [ 374.231683] gitaly[925]: time="2026-08-20T05:54:07.882Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQNP6QKCX3C1GZN0GTJ1Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:54:37.879" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:07.880" grpc.time_ms=1.191 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1987gitlab # [ 374.244169] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.142Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bef47a9667d0e7e246f7f1dc","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bef47a9667d0e7e246f7f1dc: done: 0.016271 sec","job_status":"done","queue_duration_s":0.836071,"scheduling_latency_s":0.836088,"redis_calls":13,"redis_duration_s":0.001654,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000615,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001039,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011082,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016271,"completed_at":"2026-08-20T05:54:06.142Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1988gitlab # [ 374.283072] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.143Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4ad0ed143ca226217526f22b","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4ad0ed143ca226217526f22b: start","job_status":"start","queue_duration_s":0.853539,"scheduling_latency_s":0.853558}1989gitlab # [ 374.296288] gitaly[925]: time="2026-08-20T05:54:07.901Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQNP6QKCX3C1GZN0GTJ1Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T05:54:17.025" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:54:07.885" grpc.time_ms=15.151 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1990gitlab # [ 374.310427] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.159Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4ad0ed143ca226217526f22b","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4ad0ed143ca226217526f22b: done: 0.016011 sec","job_status":"done","queue_duration_s":0.853539,"scheduling_latency_s":0.853558,"redis_calls":13,"redis_duration_s":0.0017920000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000749,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001043,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011045,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016011,"completed_at":"2026-08-20T05:54:06.159Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1991gitlab # [ 374.349865] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.160Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"25fac9012cf860e22dbe4322","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-25fac9012cf860e22dbe4322: start","job_status":"start","queue_duration_s":0.870745,"scheduling_latency_s":0.870763}1992gitlab # [ 374.362190] gitaly[925]: time="2026-08-20T05:54:07.960Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQNP6QKCX3C1GZN0GTJ1Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T05:54:37.057" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:07.958" grpc.time_ms=1.792 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1993gitlab # [ 374.375022] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.176Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"25fac9012cf860e22dbe4322","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-25fac9012cf860e22dbe4322: done: 0.016363 sec","job_status":"done","queue_duration_s":0.870745,"scheduling_latency_s":0.870763,"redis_calls":13,"redis_duration_s":0.001718,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000668,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00105,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01119,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016363,"completed_at":"2026-08-20T05:54:06.176Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1994gitlab # [ 374.414523] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.178Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c19fcef24e3cadf8420b5b73","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c19fcef24e3cadf8420b5b73: start","job_status":"start","queue_duration_s":0.88826,"scheduling_latency_s":0.888278}1995gitlab # [ 374.426685] gitaly[925]: time="2026-08-20T05:54:07.970Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=133 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQNP6QKCX3C1GZN0GTJ1Q error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-20T05:54:37.064" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:07.965" grpc.time_ms=4.548 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1996gitlab # [ 374.442936] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.194Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c19fcef24e3cadf8420b5b73","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c19fcef24e3cadf8420b5b73: done: 0.015892 sec","job_status":"done","queue_duration_s":0.88826,"scheduling_latency_s":0.888278,"redis_calls":13,"redis_duration_s":0.002733,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000709,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002024,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009977,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015892,"completed_at":"2026-08-20T05:54:06.193Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1997gitlab # [ 374.482414] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.196Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"78e2cbf50f52b3a48adcd775","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-78e2cbf50f52b3a48adcd775: start","job_status":"start","queue_duration_s":0.906374,"scheduling_latency_s":0.906391}1998gitlab # [ 374.494929] gitaly[925]: time="2026-08-20T05:54:08.030Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQNP6QKCX3C1GZN0GTJ1Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:54:18.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:54:08.011" grpc.time_ms=18.592 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1999gitlab # [ 374.508203] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.211Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"78e2cbf50f52b3a48adcd775","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-78e2cbf50f52b3a48adcd775: done: 0.015703 sec","job_status":"done","queue_duration_s":0.906374,"scheduling_latency_s":0.906391,"redis_calls":13,"redis_duration_s":0.002082,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000984,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010633,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015703,"completed_at":"2026-08-20T05:54:06.211Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2000gitlab # [ 374.548388] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.214Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ac6b0cff7d0fcc94c64a475","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ac6b0cff7d0fcc94c64a475: start","job_status":"start","queue_duration_s":0.924238,"scheduling_latency_s":0.924257}2001gitlab # [ 374.560757] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.229Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ac6b0cff7d0fcc94c64a475","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ac6b0cff7d0fcc94c64a475: done: 0.014949 sec","job_status":"done","queue_duration_s":0.924238,"scheduling_latency_s":0.924257,"redis_calls":13,"redis_duration_s":0.001857,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000624,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001233,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009624,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014949,"completed_at":"2026-08-20T05:54:06.229Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2002gitlab # [ 374.599801] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.230Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51cd3f29c0dd9ccb8451b672","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51cd3f29c0dd9ccb8451b672: start","job_status":"start","queue_duration_s":0.940692,"scheduling_latency_s":0.94071}2003gitlab # [ 374.612418] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.248Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51cd3f29c0dd9ccb8451b672","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51cd3f29c0dd9ccb8451b672: done: 0.018033 sec","job_status":"done","queue_duration_s":0.940692,"scheduling_latency_s":0.94071,"redis_calls":13,"redis_duration_s":0.004804,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000925,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003879,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010337,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018033,"completed_at":"2026-08-20T05:54:06.248Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2004gitlab # [ 374.651738] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.249Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d15a7c0d14bb4c681d77eb14","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d15a7c0d14bb4c681d77eb14: start","job_status":"start","queue_duration_s":0.959911,"scheduling_latency_s":0.959927}2005gitlab # [ 374.664370] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.267Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d15a7c0d14bb4c681d77eb14","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d15a7c0d14bb4c681d77eb14: done: 0.017295 sec","job_status":"done","queue_duration_s":0.959911,"scheduling_latency_s":0.959927,"redis_calls":13,"redis_duration_s":0.00443,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001339,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003091,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00988,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017295,"completed_at":"2026-08-20T05:54:06.267Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2006gitlab # [ 374.703874] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.269Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f928ecf1c834c12660b471c","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f928ecf1c834c12660b471c: start","job_status":"start","queue_duration_s":0.979593,"scheduling_latency_s":0.97961}2007gitlab # [ 374.717639] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.285Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f928ecf1c834c12660b471c","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f928ecf1c834c12660b471c: done: 0.016142 sec","job_status":"done","queue_duration_s":0.979593,"scheduling_latency_s":0.97961,"redis_calls":13,"redis_duration_s":0.003279,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000743,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002536,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009924,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016142,"completed_at":"2026-08-20T05:54:06.285Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2008gitlab # [ 374.756541] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.286Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0854d99dbb96e32d59ed4760","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0854d99dbb96e32d59ed4760: start","job_status":"start","queue_duration_s":0.996894,"scheduling_latency_s":0.996911}2009gitlab # [ 374.770919] gitaly[925]: time="2026-08-20T05:54:08.605Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=22 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=880 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=2 command.system_time_ms=22 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQNP6QKCX3C1GZN0GTJ1Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-20T05:54:38.075" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:08.575" grpc.time_ms=29.356 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2010gitlab # [ 374.786529] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.303Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0854d99dbb96e32d59ed4760","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0854d99dbb96e32d59ed4760: done: 0.016834 sec","job_status":"done","queue_duration_s":0.996894,"scheduling_latency_s":0.996911,"redis_calls":13,"redis_duration_s":0.0021520000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000918,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001234,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009926,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016834,"completed_at":"2026-08-20T05:54:06.303Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2011gitlab # [ 374.826088] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.306Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"208200edc154d58fd359dc1d","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-208200edc154d58fd359dc1d: start","job_status":"start","queue_duration_s":1.01639,"scheduling_latency_s":1.016408}2012gitlab # [ 374.841317] gitaly[925]: time="2026-08-20T05:54:08.635Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=3 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQNP6QKCX3C1GZN0GTJ1Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-20T05:54:38.108" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:08.609" grpc.time_ms=26.208 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2013gitlab # [ 374.854624] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.322Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"208200edc154d58fd359dc1d","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-208200edc154d58fd359dc1d: done: 0.01664 sec","job_status":"done","queue_duration_s":1.01639,"scheduling_latency_s":1.016408,"redis_calls":13,"redis_duration_s":0.003379,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000701,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002678,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010186,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01664,"completed_at":"2026-08-20T05:54:06.322Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2014gitlab # [ 374.894327] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.324Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e7d8ff8f1e8b7345d6c3f95","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e7d8ff8f1e8b7345d6c3f95: start","job_status":"start","queue_duration_s":1.034199,"scheduling_latency_s":1.034216}2015gitlab # [ 374.906818] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.340Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e7d8ff8f1e8b7345d6c3f95","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e7d8ff8f1e8b7345d6c3f95: done: 0.016804 sec","job_status":"done","queue_duration_s":1.034199,"scheduling_latency_s":1.034216,"redis_calls":13,"redis_duration_s":0.002946,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001502,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001444,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010528,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016804,"completed_at":"2026-08-20T05:54:06.340Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2016gitlab # [ 374.947299] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.342Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7715d89ab2d01094efb19bc4","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7715d89ab2d01094efb19bc4: start","job_status":"start","queue_duration_s":1.052257,"scheduling_latency_s":1.052275}2017gitlab # [ 374.959840] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.360Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7715d89ab2d01094efb19bc4","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7715d89ab2d01094efb19bc4: done: 0.018033 sec","job_status":"done","queue_duration_s":1.052257,"scheduling_latency_s":1.052275,"redis_calls":13,"redis_duration_s":0.0034990000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001211,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002288,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011234,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018033,"completed_at":"2026-08-20T05:54:06.360Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2018gitlab # [ 374.999491] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.361Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"18d64f68e11ed2796a7bda18","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-18d64f68e11ed2796a7bda18: start","job_status":"start","queue_duration_s":1.07147,"scheduling_latency_s":1.071489}2019gitlab # [ 375.012185] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.378Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"18d64f68e11ed2796a7bda18","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-18d64f68e11ed2796a7bda18: done: 0.016682 sec","job_status":"done","queue_duration_s":1.07147,"scheduling_latency_s":1.071489,"redis_calls":13,"redis_duration_s":0.0015,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000965,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010286,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016682,"completed_at":"2026-08-20T05:54:06.377Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2020gitlab # [ 375.051239] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.379Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3a1c179c679175973b1e8fa","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3a1c179c679175973b1e8fa: start","job_status":"start","queue_duration_s":1.089303,"scheduling_latency_s":1.089321}2021gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d'2022gitlab # [ 375.063841] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.393Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3a1c179c679175973b1e8fa","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3a1c179c679175973b1e8fa: done: 0.014731 sec","job_status":"done","queue_duration_s":1.089303,"scheduling_latency_s":1.089321,"redis_calls":13,"redis_duration_s":0.001422,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000913,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010079,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014731,"completed_at":"2026-08-20T05:54:06.393Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2023gitlab # [ 375.102404] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.395Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6df9839a77a8383632389eae","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6df9839a77a8383632389eae: start","job_status":"start","queue_duration_s":1.105215,"scheduling_latency_s":1.105232}2024gitlab # [ 375.114204] nixbot[3752]: INFO: ::ffff:127.0.0.1:47734 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted2025gitlab # [ 375.115371] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.409Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6df9839a77a8383632389eae","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6df9839a77a8383632389eae: done: 0.01468 sec","job_status":"done","queue_duration_s":1.105215,"scheduling_latency_s":1.105232,"redis_calls":13,"redis_duration_s":0.001414,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000896,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010124,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01468,"completed_at":"2026-08-20T05:54:06.409Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2026gitlab # [ 375.157903] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.410Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f9bfb4e8c4e88fc69bfdd913","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f9bfb4e8c4e88fc69bfdd913: start","job_status":"start","queue_duration_s":1.121028,"scheduling_latency_s":1.121046}2027gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d', in 0.11 seconds)2028gitlab # [ 375.170658] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.425Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f9bfb4e8c4e88fc69bfdd913","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f9bfb4e8c4e88fc69bfdd913: done: 0.014545 sec","job_status":"done","queue_duration_s":1.121028,"scheduling_latency_s":1.121046,"redis_calls":13,"redis_duration_s":0.001583,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000634,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000949,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009882,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014545,"completed_at":"2026-08-20T05:54:06.425Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2029gitlab # [ 375.210734] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.426Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0728fd05af35f28b0ba6fc22","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0728fd05af35f28b0ba6fc22: start","job_status":"start","queue_duration_s":1.136654,"scheduling_latency_s":1.13667}2030gitlab # [ 375.223188] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.441Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0728fd05af35f28b0ba6fc22","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0728fd05af35f28b0ba6fc22: done: 0.014678 sec","job_status":"done","queue_duration_s":1.136654,"scheduling_latency_s":1.13667,"redis_calls":13,"redis_duration_s":0.001837,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000646,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001191,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009894,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014678,"completed_at":"2026-08-20T05:54:06.441Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2031gitlab # [ 375.263179] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.442Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d645a41efbb6ad5011cbde9","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d645a41efbb6ad5011cbde9: start","job_status":"start","queue_duration_s":1.152474,"scheduling_latency_s":1.152492}2032gitlab # [ 375.276004] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/08/20:05:54:09 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1262033gitlab # [ 375.278085] nixbot[3752]: INFO: ::ffff:127.0.0.1:47738 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d HTTP/1.1" 200 OK2034gitlab # [ 375.279962] gitaly[925]: time="2026-08-20T05:54:09.117Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=577 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=4 command.system_time_ms=1 command.user_time_ms=8 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQSYZF34YBMZ3BDWWA4YK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:54:09.094" grpc.time_ms=23.029 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc2035gitlab # [ 375.293546] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.457Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d645a41efbb6ad5011cbde9","created_at":"2026-08-20T05:54:05.185Z","trace_propagation_headers":{"sentry-trace":"c6a7683547b947838c39c7e1ca22abe6-e6b16a9eb5344c6e","baggage":"sentry-trace_id=c6a7683547b947838c39c7e1ca22abe6,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"2bd74402c23c920b7dc6cedbfec9aa73","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.289Z","job_size_bytes":2,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d645a41efbb6ad5011cbde9: done: 0.015024 sec","job_status":"done","queue_duration_s":1.152474,"scheduling_latency_s":1.152492,"redis_calls":13,"redis_duration_s":0.001911,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000608,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001303,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0101,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015024,"completed_at":"2026-08-20T05:54:06.457Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2036gitlab # [ 375.332410] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.458Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","42e3f64711217c5a5b26574a2bedc4bb007a4058 b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"9a2a12f10f8598a523200dd9","created_at":"2026-08-20T05:54:05.520Z","trace_propagation_headers":{"sentry-trace":"0978fdab1952450f97cc60a68bd34580-05336bcc1f754c83","baggage":"sentry-trace_id=0978fdab1952450f97cc60a68bd34580,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVQNP6QKCX3C1GZN0GTJ1Q","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.523Z","job_size_bytes":185,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-9a2a12f10f8598a523200dd9: start","job_status":"start","queue_duration_s":0.935738,"scheduling_latency_s":0.935755}2037gitlab # [ 375.350164] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:06.471Z","message":"changes: \"42e3f64711217c5a5b26574a2bedc4bb007a4058 b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d refs/heads/master\\n\""}2038gitlab # [ 375.352558] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:07.035Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","42e3f64711217c5a5b26574a2bedc4bb007a4058 b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"9a2a12f10f8598a523200dd9","created_at":"2026-08-20T05:54:05.520Z","trace_propagation_headers":{"sentry-trace":"0978fdab1952450f97cc60a68bd34580-05336bcc1f754c83","baggage":"sentry-trace_id=0978fdab1952450f97cc60a68bd34580,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVQNP6QKCX3C1GZN0GTJ1Q","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:54:05.523Z","job_size_bytes":185,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-9a2a12f10f8598a523200dd9: done: 0.57647 sec","job_status":"done","queue_duration_s":0.935738,"scheduling_latency_s":0.935755,"gitaly_calls":7,"gitaly_duration_s":0.075028,"redis_calls":108,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.032222,"redis_read_bytes":349,"redis_write_bytes":12823,"redis_cache_calls":5,"redis_cache_duration_s":0.002377,"redis_cache_read_bytes":13,"redis_cache_write_bytes":347,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000707,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":323,"redis_queues_calls":8,"redis_queues_duration_s":0.002606,"redis_queues_read_bytes":8,"redis_queues_write_bytes":6769,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.002678,"redis_queues_metadata_read_bytes":11,"redis_queues_metadata_write_bytes":1182,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.007257,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.016597,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.046,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.035,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.035,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.046,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.424151,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00065082,"exclusive_lock_hold_duration_s":0.02050028,"duration_s":0.57647,"completed_at":"2026-08-20T05:54:07.035Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.059706,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2039gitlab # [ 375.403122] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:07.037Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"bf549a04f1fdb66013bad16c","created_at":"2026-08-20T05:54:06.443Z","trace_propagation_headers":{"sentry-trace":"8d8297c659904c16986131de4b4ded61-3ee5ee64cf754ea8","baggage":"sentry-trace_id=8d8297c659904c16986131de4b4ded61,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVQQ2BV4G2QVT8F1K95CTZ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:06.454Z","job_size_bytes":65,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-bf549a04f1fdb66013bad16c: start","job_status":"start","queue_duration_s":0.582796,"scheduling_latency_s":0.582826}2040gitlab # [ 375.420544] gitaly[925]: time="2026-08-20T05:54:09.219Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQT31K0GKJ9WVQWAMD556 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:54:09.196" pid=925 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2041gitlab # [ 375.430793] gitlab-workhorse[823]: time="2026-08-20T05:54:09Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672042gitlab # [ 375.432674] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/08/20:05:54:09 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 992043gitlab # [ 375.434533] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:07.124Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"bf549a04f1fdb66013bad16c","created_at":"2026-08-20T05:54:06.443Z","trace_propagation_headers":{"sentry-trace":"8d8297c659904c16986131de4b4ded61-3ee5ee64cf754ea8","baggage":"sentry-trace_id=8d8297c659904c16986131de4b4ded61,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVQQ2BV4G2QVT8F1K95CTZ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:06.454Z","job_size_bytes":65,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-bf549a04f1fdb66013bad16c: done: 0.087407 sec","job_status":"done","queue_duration_s":0.582796,"scheduling_latency_s":0.582826,"redis_calls":25,"redis_duration_s":0.004585,"redis_read_bytes":913,"redis_write_bytes":2689,"redis_feature_flag_calls":17,"redis_feature_flag_duration_s":0.003144,"redis_feature_flag_read_bytes":906,"redis_feature_flag_write_bytes":1871,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001065,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000376,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.056786,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00052224,"duration_s":0.087407,"completed_at":"2026-08-20T05:54:07.124Z","load_balancing_strategy":"primary","db_duration_s":0.01832,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2044gitlab # [ 375.480240] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:07.126Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"ce1b602ed8042a11201a6b5f","created_at":"2026-08-20T05:54:06.455Z","trace_propagation_headers":{"sentry-trace":"8d8297c659904c16986131de4b4ded61-3ee5ee64cf754ea8","baggage":"sentry-trace_id=8d8297c659904c16986131de4b4ded61,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVQQ2BV4G2QVT8F1K95CTZ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:06.465Z","job_size_bytes":65,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-ce1b602ed8042a11201a6b5f: start","job_status":"start","queue_duration_s":0.660629,"scheduling_latency_s":0.660655}2045gitlab # [ 375.497696] gitaly[925]: time="2026-08-20T05:54:09.219Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=0 command.system_time_ms=17 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQT31K0GKJ9WVQWAMD556 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:54:09.196" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc2046gitlab # [ 375.511462] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:07.225Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"ce1b602ed8042a11201a6b5f","created_at":"2026-08-20T05:54:06.455Z","trace_propagation_headers":{"sentry-trace":"8d8297c659904c16986131de4b4ded61-3ee5ee64cf754ea8","baggage":"sentry-trace_id=8d8297c659904c16986131de4b4ded61,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVQQ2BV4G2QVT8F1K95CTZ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:06.465Z","job_size_bytes":65,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-ce1b602ed8042a11201a6b5f: done: 0.098832 sec","job_status":"done","queue_duration_s":0.660629,"scheduling_latency_s":0.660655,"redis_calls":17,"redis_duration_s":0.004483,"redis_read_bytes":144,"redis_write_bytes":1714,"redis_feature_flag_calls":5,"redis_feature_flag_duration_s":0.001605,"redis_feature_flag_read_bytes":132,"redis_feature_flag_write_bytes":714,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001266,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001612,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":13,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":13,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.073168,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00042594,"duration_s":0.098832,"completed_at":"2026-08-20T05:54:07.224Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015946,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2047gitlab # [ 375.559544] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:07.226Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"0050112e779e64524a92a468","created_at":"2026-08-20T05:54:06.516Z","trace_propagation_headers":{"sentry-trace":"0978fdab1952450f97cc60a68bd34580-30f2816df3da43ca","baggage":"sentry-trace_id=0978fdab1952450f97cc60a68bd34580,sentry-release=Unknown"},"correlation_id":"01M0EVQNP6QKCX3C1GZN0GTJ1Q","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:06.518Z","job_size_bytes":46,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-0050112e779e64524a92a468: start","job_status":"start","queue_duration_s":0.707916,"scheduling_latency_s":0.707938}2048gitlab # [ 375.575889] gitaly[925]: time="2026-08-20T05:54:09.220Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=0 command.system_time_ms=17 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQT31K0GKJ9WVQWAMD556 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:54:09.196" grpc.time_ms=23.742 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc2049gitlab # [ 375.590649] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/08/20:05:54:09 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1312050gitlab # [ 375.592798] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:07.267Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"0050112e779e64524a92a468","created_at":"2026-08-20T05:54:06.516Z","trace_propagation_headers":{"sentry-trace":"0978fdab1952450f97cc60a68bd34580-30f2816df3da43ca","baggage":"sentry-trace_id=0978fdab1952450f97cc60a68bd34580,sentry-release=Unknown"},"correlation_id":"01M0EVQNP6QKCX3C1GZN0GTJ1Q","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:06.518Z","job_size_bytes":46,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-0050112e779e64524a92a468: done: 0.040972 sec","job_status":"done","queue_duration_s":0.707916,"scheduling_latency_s":0.707938,"redis_calls":9,"redis_duration_s":0.005351,"redis_read_bytes":23,"redis_write_bytes":782,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003487,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":1,"redis_repository_cache_duration_s":0.000857,"redis_repository_cache_read_bytes":18,"redis_repository_cache_write_bytes":41,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001007,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":304,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029757,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.040972,"completed_at":"2026-08-20T05:54:07.267Z","load_balancing_strategy":"primary","db_duration_s":0.004039,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2051gitlab # [ 375.638033] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:07.270Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"e355cc5875fca4c65002a9ff","created_at":"2026-08-20T05:54:06.527Z","trace_propagation_headers":{"sentry-trace":"0978fdab1952450f97cc60a68bd34580-30f2816df3da43ca","baggage":"sentry-trace_id=0978fdab1952450f97cc60a68bd34580,sentry-release=Unknown"},"correlation_id":"01M0EVQNP6QKCX3C1GZN0GTJ1Q","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:06.529Z","job_size_bytes":3,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-e355cc5875fca4c65002a9ff: start","job_status":"start","queue_duration_s":0.74159,"scheduling_latency_s":0.741632}2052gitlab # [ 375.655088] gitaly[925]: time="2026-08-20T05:54:09.430Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQT8J3H92K6JW7BNFK385 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:54:09.411" grpc.time_ms=18.162 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc2053gitlab # [ 375.668854] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:07.405Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"e355cc5875fca4c65002a9ff","created_at":"2026-08-20T05:54:06.527Z","trace_propagation_headers":{"sentry-trace":"0978fdab1952450f97cc60a68bd34580-30f2816df3da43ca","baggage":"sentry-trace_id=0978fdab1952450f97cc60a68bd34580,sentry-release=Unknown"},"correlation_id":"01M0EVQNP6QKCX3C1GZN0GTJ1Q","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:06.529Z","job_size_bytes":3,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-e355cc5875fca4c65002a9ff: done: 0.134569 sec","job_status":"done","queue_duration_s":0.74159,"scheduling_latency_s":0.741632,"gitaly_calls":1,"gitaly_duration_s":0.054841,"redis_calls":12,"redis_duration_s":0.004587,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001972,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000815,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.0018,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.017,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.017,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.063678,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.09219996,"duration_s":0.134569,"completed_at":"2026-08-20T05:54:07.405Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011177,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2054gitlab # [ 375.715326] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:07.408Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"e2a80de0edc0933e59ae5ecd","created_at":"2026-08-20T05:54:06.648Z","trace_propagation_headers":{"sentry-trace":"8d8297c659904c16986131de4b4ded61-3ee5ee64cf754ea8","baggage":"sentry-trace_id=8d8297c659904c16986131de4b4ded61,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVQQ2BV4G2QVT8F1K95CTZ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:06.656Z","job_size_bytes":3,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e2a80de0edc0933e59ae5ecd: start","job_status":"start","queue_duration_s":0.751685,"scheduling_latency_s":0.751722}2055gitlab # [ 375.731953] gitaly[925]: time="2026-08-20T05:54:09.582Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQTCTSH0YQSWFGQPVNJGE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:54:09.547" pid=925 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc2056gitlab # [ 375.742733] gitlab-workhorse[823]: time="2026-08-20T05:54:09Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2162057gitlab # [ 375.744674] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/08/20:05:54:09 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 1482058gitlab # [ 375.746573] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:07.839Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"e2a80de0edc0933e59ae5ecd","created_at":"2026-08-20T05:54:06.648Z","trace_propagation_headers":{"sentry-trace":"8d8297c659904c16986131de4b4ded61-3ee5ee64cf754ea8","baggage":"sentry-trace_id=8d8297c659904c16986131de4b4ded61,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVQQ2BV4G2QVT8F1K95CTZ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:06.656Z","job_size_bytes":3,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e2a80de0edc0933e59ae5ecd: done: 0.43119 sec","job_status":"done","queue_duration_s":0.751685,"scheduling_latency_s":0.751722,"gitaly_calls":2,"gitaly_duration_s":0.013697,"redis_calls":45,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.024936,"redis_read_bytes":324,"redis_write_bytes":6703,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.004904,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":8,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.002859,"redis_cache_read_bytes":16,"redis_cache_write_bytes":735,"redis_feature_flag_calls":12,"redis_feature_flag_duration_s":0.005259,"redis_feature_flag_read_bytes":266,"redis_feature_flag_write_bytes":1627,"redis_queues_calls":2,"redis_queues_duration_s":0.000838,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.002392,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":840,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.001133,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":1,"redis_repository_cache_duration_s":0.000368,"redis_repository_cache_read_bytes":18,"redis_repository_cache_write_bytes":41,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002279,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":32,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":32,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.063,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":19,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.008,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.014,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.036,"db_ci_duration_s":0.028,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.34141,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.33833806,"duration_s":0.43119,"completed_at":"2026-08-20T05:54:07.839Z","load_balancing_strategy":"primary","db_duration_s":0.072035,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2059gitlab # [ 375.804314] gitaly[925]: time="2026-08-20T05:54:09.582Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=28 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1104 command.oublock=0 command.real_time_ms=30 command.spawn_token_fork_ms=2 command.system_time_ms=24 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQTCTSH0YQSWFGQPVNJGE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:54:09.547" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc2060gitlab # [ 375.818499] nixbot[3752]: {"ts": "2026-08-20T05:54:09.650Z", "level": "info", "logger": "nixbot.canceller", "msg": "cancelling build", "build_id": 1, "reason": "superseded"}2061gitlab # [ 375.820631] nix-daemon[4098]: unexpected Nix daemon error: error: interrupted by the user2062gitlab # [ 375.821861] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:07.842Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"018b748d6b537376c4058541","created_at":"2026-08-20T05:54:06.668Z","trace_propagation_headers":{"sentry-trace":"0978fdab1952450f97cc60a68bd34580-30f2816df3da43ca","baggage":"sentry-trace_id=0978fdab1952450f97cc60a68bd34580,sentry-release=Unknown"},"correlation_id":"01M0EVQNP6QKCX3C1GZN0GTJ1Q","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7563682eddef05586abff879bafac1d8446f8abfe55733dbfabdf9b8d4e4f769","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:06.673Z","job_size_bytes":467,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-018b748d6b537376c4058541: start","job_status":"start","queue_duration_s":1.16873,"scheduling_latency_s":1.168764}2063gitlab # [ 375.839107] sidekiq-cluster[2156]: {"severity":"WARN","time":"2026-08-20T05:54:08.663Z","class":"CreatePipelineWorker","correlation_id":"01M0EVQNP6QKCX3C1GZN0GTJ1Q","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"42e3f64711217c5a5b26574a2bedc4bb007a4058","after":"b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d","ref":"refs/heads/master"},"retry":0}2064gitlab # [ 375.846396] gitaly[925]: time="2026-08-20T05:54:09.583Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=28 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1104 command.oublock=0 command.real_time_ms=30 command.spawn_token_fork_ms=2 command.system_time_ms=24 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQTCTSH0YQSWFGQPVNJGE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:54:09.547" grpc.time_ms=34.925 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc2065gitlab # [ 375.861368] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:08.672Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"018b748d6b537376c4058541","created_at":"2026-08-20T05:54:06.668Z","trace_propagation_headers":{"sentry-trace":"0978fdab1952450f97cc60a68bd34580-30f2816df3da43ca","baggage":"sentry-trace_id=0978fdab1952450f97cc60a68bd34580,sentry-release=Unknown"},"correlation_id":"01M0EVQNP6QKCX3C1GZN0GTJ1Q","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7563682eddef05586abff879bafac1d8446f8abfe55733dbfabdf9b8d4e4f769","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:06.673Z","job_size_bytes":467,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-018b748d6b537376c4058541: done: 0.830191 sec","job_status":"done","queue_duration_s":1.16873,"scheduling_latency_s":1.168764,"gitaly_calls":7,"gitaly_duration_s":0.122958,"redis_calls":33,"redis_duration_s":0.008684,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.001202,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001855,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.004133,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001494,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.035,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.03,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.680786,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.830191,"completed_at":"2026-08-20T05:54:08.672Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.034752,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2066gitlab # [ 375.909408] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:08.676Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"e8e97f72-b1d2-4757-a658-178545adac8d\"}"],"class":"WebHookWorker","jid":"e4ec1f4d6df618d97ef82660","created_at":"2026-08-20T05:54:06.966Z","trace_propagation_headers":{"sentry-trace":"0978fdab1952450f97cc60a68bd34580-30f2816df3da43ca","baggage":"sentry-trace_id=0978fdab1952450f97cc60a68bd34580,sentry-release=Unknown"},"correlation_id":"01M0EVQNP6QKCX3C1GZN0GTJ1Q","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:05ec04b13488d10c48aa122fa72cc119898acdfad82d4a46172c13f2c1c7fe0e","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:06.977Z","job_size_bytes":1749,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-e4ec1f4d6df618d97ef82660: start","job_status":"start","queue_duration_s":1.698521,"scheduling_latency_s":1.698558}2067gitlab # [ 375.926895] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:08.982Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"e8e97f72-b1d2-4757-a658-178545adac8d\"}"],"class":"WebHookWorker","jid":"e4ec1f4d6df618d97ef82660","created_at":"2026-08-20T05:54:06.966Z","trace_propagation_headers":{"sentry-trace":"0978fdab1952450f97cc60a68bd34580-30f2816df3da43ca","baggage":"sentry-trace_id=0978fdab1952450f97cc60a68bd34580,sentry-release=Unknown"},"correlation_id":"01M0EVQNP6QKCX3C1GZN0GTJ1Q","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:05ec04b13488d10c48aa122fa72cc119898acdfad82d4a46172c13f2c1c7fe0e","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:06.977Z","job_size_bytes":1749,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-e4ec1f4d6df618d97ef82660: done: 0.306191 sec","job_status":"done","queue_duration_s":1.698521,"scheduling_latency_s":1.698558,"redis_calls":19,"redis_duration_s":0.01115,"redis_read_bytes":31,"redis_write_bytes":5365,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.005633,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000822,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3727,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003132,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001563,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.09609660000000986,"cpu_s":0.178401,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0010002,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.306191,"completed_at":"2026-08-20T05:54:08.981Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005751,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2068gitlab # [ 375.977005] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:08.985Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"3fdd16880dee0d5ee935ed9d","created_at":"2026-08-20T05:54:07.645Z","trace_propagation_headers":{"sentry-trace":"8d8297c659904c16986131de4b4ded61-3b2fbc513fed4b3b","baggage":"sentry-trace_id=8d8297c659904c16986131de4b4ded61,sentry-release=Unknown"},"correlation_id":"01M0EVQQ2BV4G2QVT8F1K95CTZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:07.662Z","job_size_bytes":3,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-3fdd16880dee0d5ee935ed9d: start","job_status":"start","queue_duration_s":1.323624,"scheduling_latency_s":1.323676}2069gitlab # [ 375.993100] gitaly[925]: time="2026-08-20T05:54:09.798Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQTKTWA5RWQ8BYDJ54V8Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:54:39.096" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:09.797" grpc.time_ms=1.109 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2070gitlab # [ 376.006007] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:09.090Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"3fdd16880dee0d5ee935ed9d","created_at":"2026-08-20T05:54:07.645Z","trace_propagation_headers":{"sentry-trace":"8d8297c659904c16986131de4b4ded61-3b2fbc513fed4b3b","baggage":"sentry-trace_id=8d8297c659904c16986131de4b4ded61,sentry-release=Unknown"},"correlation_id":"01M0EVQQ2BV4G2QVT8F1K95CTZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:07.662Z","job_size_bytes":3,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-3fdd16880dee0d5ee935ed9d: done: 0.104232 sec","job_status":"done","queue_duration_s":1.323624,"scheduling_latency_s":1.323676,"redis_calls":10,"redis_duration_s":0.0034089999999999997,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000708,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001989,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000712,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.067359,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00068524,"duration_s":0.104232,"completed_at":"2026-08-20T05:54:09.089Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014934,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2071gitlab # [ 376.050345] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:09.097Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","e4ec1f4d6df618d97ef82660"],"class":"WebHooks::LogExecutionWorker","jid":"d2d05212148a377cf619b18b","created_at":"2026-08-20T05:54:08.939Z","trace_propagation_headers":{"sentry-trace":"0978fdab1952450f97cc60a68bd34580-454ec52ce3484ae3","baggage":"sentry-trace_id=0978fdab1952450f97cc60a68bd34580,sentry-release=Unknown"},"correlation_id":"01M0EVQNP6QKCX3C1GZN0GTJ1Q","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b446db99c1fffe784979440dc8d58b7245a3b82d83541ff16d064a3d724193a2","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:08.957Z","job_size_bytes":2590,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-d2d05212148a377cf619b18b: start","job_status":"start","queue_duration_s":0.139467,"scheduling_latency_s":0.139514}2072gitlab # [ 376.067888] gitaly[925]: time="2026-08-20T05:54:09.838Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=590 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQTKTWA5RWQ8BYDJ54V8Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-20T05:54:39.117" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:54:09.817" grpc.time_ms=20.142 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2073gitlab # [ 376.082678] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:09.184Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","e4ec1f4d6df618d97ef82660"],"class":"WebHooks::LogExecutionWorker","jid":"d2d05212148a377cf619b18b","created_at":"2026-08-20T05:54:08.939Z","trace_propagation_headers":{"sentry-trace":"0978fdab1952450f97cc60a68bd34580-454ec52ce3484ae3","baggage":"sentry-trace_id=0978fdab1952450f97cc60a68bd34580,sentry-release=Unknown"},"correlation_id":"01M0EVQNP6QKCX3C1GZN0GTJ1Q","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b446db99c1fffe784979440dc8d58b7245a3b82d83541ff16d064a3d724193a2","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:08.957Z","job_size_bytes":2590,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-d2d05212148a377cf619b18b: done: 0.08745 sec","job_status":"done","queue_duration_s":0.139467,"scheduling_latency_s":0.139514,"redis_calls":10,"redis_duration_s":0.009821,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001608,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003298,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004915,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.01,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.01,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.054872,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00043562,"duration_s":0.08745,"completed_at":"2026-08-20T05:54:09.184Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014429,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2074gitlab # [ 376.128837] gitaly[925]: time="2026-08-20T05:54:09.866Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQTPBFXQE12ZGYAHNYVGT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:54:39.064" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:09.864" grpc.time_ms=1.073 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2075gitlab # [ 376.141163] gitaly[925]: time="2026-08-20T05:54:09.875Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=3 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQTKTWA5RWQ8BYDJ54V8Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:54:19.003" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:54:09.854" grpc.time_ms=20.464 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2076gitlab # [ 376.154461] gitaly[925]: time="2026-08-20T05:54:09.946Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQTKTWA5RWQ8BYDJ54V8Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T05:54:19.093" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:54:09.945" grpc.time_ms=0.702 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2077gitlab # [ 376.166850] gitaly[925]: time="2026-08-20T05:54:09.972Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQTKTWA5RWQ8BYDJ54V8Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T05:54:19.103" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:54:09.954" grpc.time_ms=17.351 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2078gitlab # [ 376.181142] gitaly[925]: time="2026-08-20T05:54:10.036Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=6 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQTPBFXQE12ZGYAHNYVGT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:54:20.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:54:10.017" grpc.time_ms=18.536 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2079gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d'2080gitlab # [ 376.194481] gitaly[925]: time="2026-08-20T05:54:10.046Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVQTKTWA5RWQ8BYDJ54V8Q grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4153 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:54:10.046" grpc.time_ms=0.514 pid=925 span.kind=server system=grpc2081gitlab # [ 376.203723] gitaly[925]: time="2026-08-20T05:54:10.080Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVQTKTWA5RWQ8BYDJ54V8Q grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:54:10.079" grpc.time_ms=0.86 pid=925 span.kind=server system=grpc2082gitlab # [ 376.213105] gitaly[925]: time="2026-08-20T05:54:10.091Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQTKTWA5RWQ8BYDJ54V8Q diskcache=608bbfe5-f6fc-40b5-976a-a997bfc51d80 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T05:54:19.127" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:54:09.977" pid=925 ref=refs/keep-around/b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d remote_ip="2001:db8:1::1" revision=b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d span.kind=server system=grpc username=root2083gitlab # [ 376.223870] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:10.107Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"2700baab692714618967239e","created_at":"2026-08-20T05:54:10.099Z","trace_propagation_headers":{"sentry-trace":"7c557ae3e56f49c6be0291bf9433b0ca-62d0aefa037b42a6","baggage":"sentry-trace_id=7c557ae3e56f49c6be0291bf9433b0ca,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVQTKTWA5RWQ8BYDJ54V8Q","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:10.104Z","job_size_bytes":65,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-2700baab692714618967239e: start","job_status":"start","queue_duration_s":0.003836,"scheduling_latency_s":0.003902}2084gitlab # [ 376.239722] gitaly[925]: time="2026-08-20T05:54:10.091Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=99 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5038 command.oublock=8 command.real_time_ms=103 command.spawn_token_fork_ms=2 command.system_time_ms=66 command.user_time_ms=33 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQTKTWA5RWQ8BYDJ54V8Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T05:54:19.127" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:54:09.977" grpc.time_ms=113.482 pid=925 ref=refs/keep-around/b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d remote_ip="2001:db8:1::1" revision=b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d span.kind=server system=grpc username=root2085gitlab # [ 376.255220] gitaly[925]: time="2026-08-20T05:54:10.097Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQTKTWA5RWQ8BYDJ54V8Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:54:40.096" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:10.096" grpc.time_ms=0.585 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2086gitlab # [ 376.280757] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/08/20:05:54:10 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 5372087gitlab # [ 376.283649] nixbot[3752]: {"ts": "2026-08-20T05:54:10.198Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d \"HTTP/1.1 201 Created\""}2088gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d', in 0.10 seconds)2089(finished: subtest: push delivers the webhook, in 6.08 seconds)2090subtest: eval and build post commit statuses2091gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d/statuses2092gitlab # [ 376.286919] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:10.201Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"2700baab692714618967239e","created_at":"2026-08-20T05:54:10.099Z","trace_propagation_headers":{"sentry-trace":"7c557ae3e56f49c6be0291bf9433b0ca-62d0aefa037b42a6","baggage":"sentry-trace_id=7c557ae3e56f49c6be0291bf9433b0ca,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVQTKTWA5RWQ8BYDJ54V8Q","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:10.104Z","job_size_bytes":65,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-2700baab692714618967239e: done: 0.093437 sec","job_status":"done","queue_duration_s":0.003836,"scheduling_latency_s":0.003902,"redis_calls":7,"redis_duration_s":0.005022,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004231,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000791,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.052776,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.093437,"completed_at":"2026-08-20T05:54:10.201Z","load_balancing_strategy":"primary","db_duration_s":0.016026,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2093gitlab # [ 376.334722] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:10.217Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"23929294cc840861b4e524f4","created_at":"2026-08-20T05:54:10.105Z","trace_propagation_headers":{"sentry-trace":"7c557ae3e56f49c6be0291bf9433b0ca-62d0aefa037b42a6","baggage":"sentry-trace_id=7c557ae3e56f49c6be0291bf9433b0ca,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVQTKTWA5RWQ8BYDJ54V8Q","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:10.108Z","job_size_bytes":65,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-23929294cc840861b4e524f4: start","job_status":"start","queue_duration_s":0.109449,"scheduling_latency_s":0.109505}2094gitlab # [ 376.355655] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/08/20:05:54:10 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/42e3f64711217c5a5b26574a2bedc4bb007a4058 HTTP/1.1" 201 651 "" "python-httpx/0.28.1" 4682095gitlab # [ 376.363378] nixbot[3752]: INFO: ::ffff:127.0.0.1:47744 - "GET /api/repos/gitlab/root/test-flake/builds?commit=b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d HTTP/1.1" 200 OK2096gitlab # [ 376.368100] nixbot[3752]: {"ts": "2026-08-20T05:54:10.209Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/42e3f64711217c5a5b26574a2bedc4bb007a4058 \"HTTP/1.1 201 Created\""}2097gitlab # [ 376.372202] nixbot[3752]: {"ts": "2026-08-20T05:54:10.228Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-b67f62f9ea4a-1"}2098gitlab # [ 376.385119] gitaly[925]: time="2026-08-20T05:54:10.301Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQV56N5MSXJ394CME4DR9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:54:40.299" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:10.300" grpc.time_ms=1.04 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2099gitlab # [ 376.416128] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:10.330Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"23929294cc840861b4e524f4","created_at":"2026-08-20T05:54:10.105Z","trace_propagation_headers":{"sentry-trace":"7c557ae3e56f49c6be0291bf9433b0ca-62d0aefa037b42a6","baggage":"sentry-trace_id=7c557ae3e56f49c6be0291bf9433b0ca,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVQTKTWA5RWQ8BYDJ54V8Q","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:10.108Z","job_size_bytes":65,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-23929294cc840861b4e524f4: done: 0.112792 sec","job_status":"done","queue_duration_s":0.109449,"scheduling_latency_s":0.109505,"redis_calls":10,"redis_duration_s":0.0025050000000000003,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001296,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001209,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.038,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.024,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047986,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.112792,"completed_at":"2026-08-20T05:54:10.330Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.059668,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2100gitlab # [ 376.476555] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:10.333Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"e1ffa67d168e88317637d305","created_at":"2026-08-20T05:54:10.173Z","trace_propagation_headers":{"sentry-trace":"7c557ae3e56f49c6be0291bf9433b0ca-62d0aefa037b42a6","baggage":"sentry-trace_id=7c557ae3e56f49c6be0291bf9433b0ca,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVQTKTWA5RWQ8BYDJ54V8Q","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:10.177Z","job_size_bytes":3,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e1ffa67d168e88317637d305: start","job_status":"start","queue_duration_s":0.155506,"scheduling_latency_s":0.155541}2101gitlab # [ 376.498838] nix-daemon[4046]: accepted connection from pid 4186, user nixbot2102gitlab # [ 376.499853] gitaly[925]: time="2026-08-20T05:54:10.358Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQV56N5MSXJ394CME4DR9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:54:20.159" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:54:10.349" grpc.time_ms=8.163 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2103gitlab # [ 376.516479] gitaly[925]: time="2026-08-20T05:54:10.361Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQV65NFKDGT859ES1ZWJ6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:54:40.160" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:10.360" grpc.time_ms=0.618 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2104gitlab # [ 376.532350] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/08/20:05:54:10 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/42e3f64711217c5a5b26574a2bedc4bb007a4058 HTTP/1.1" 201 665 "" "python-httpx/0.28.1" 2262105gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d/statuses, in 0.24 seconds)2106gitlab # [ 376.536178] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/08/20:05:54:10 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 2002107gitlab # [ 376.538646] nixbot[3752]: {"ts": "2026-08-20T05:54:10.442Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/42e3f64711217c5a5b26574a2bedc4bb007a4058 \"HTTP/1.1 201 Created\""}2108gitlab # [ 376.541481] gitaly[925]: time="2026-08-20T05:54:10.451Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQTKTWA5RWQ8BYDJ54V8Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T05:54:40.050" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:10.450" grpc.time_ms=0.995 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2109gitlab # [ 376.572637] nix-daemon[4046]: accepted connection from pid 4199, user nixbot2110gitlab # [ 376.577011] gitaly[925]: time="2026-08-20T05:54:10.493Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQTKTWA5RWQ8BYDJ54V8Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:54:40.092" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:10.492" grpc.time_ms=0.743 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2111gitlab # [ 376.589965] nixbot[3752]: {"ts": "2026-08-20T05:54:10.506Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-b67f62f9ea4a-1", "argv0": "bwrap"}2112gitlab # [ 376.592484] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:10.506Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"e1ffa67d168e88317637d305","created_at":"2026-08-20T05:54:10.173Z","trace_propagation_headers":{"sentry-trace":"7c557ae3e56f49c6be0291bf9433b0ca-62d0aefa037b42a6","baggage":"sentry-trace_id=7c557ae3e56f49c6be0291bf9433b0ca,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVQTKTWA5RWQ8BYDJ54V8Q","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:10.177Z","job_size_bytes":3,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-e1ffa67d168e88317637d305: done: 0.173113 sec","job_status":"done","queue_duration_s":0.155506,"scheduling_latency_s":0.155541,"gitaly_calls":2,"gitaly_duration_s":0.006525,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.031627,"redis_read_bytes":79,"redis_write_bytes":5121,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.004607,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001079,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.016868,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1132,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002198,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000326,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.001209,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000733,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.005,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.013,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.11965,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.13181398,"duration_s":0.173113,"completed_at":"2026-08-20T05:54:10.506Z","load_balancing_strategy":"primary","db_duration_s":0.025702,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2113gitlab # [ 376.643842] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:10.513Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"4ba37eac94861b27144d1549","created_at":"2026-08-20T05:54:10.163Z","trace_propagation_headers":{"sentry-trace":"d77c64a7b3064917a83d66b4492ff887-79709875a57d4f60","baggage":"sentry-trace_id=d77c64a7b3064917a83d66b4492ff887,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVQTPBFXQE12ZGYAHNYVGT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:10.178Z","job_size_bytes":3,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-4ba37eac94861b27144d1549: start","job_status":"start","queue_duration_s":0.335924,"scheduling_latency_s":0.335953}2114gitlab # [ 376.730643] nix-daemon[4046]: accepted connection from pid 4210, user nixbot2115gitlab # [ 376.786860] nix-daemon[4046]: accepted connection from pid 4220, user nixbot2116gitlab # [ 376.805196] nix-daemon[4046]: accepted connection from pid 4210, user nixbot2117gitlab # [ 376.825498] gitaly[925]: time="2026-08-20T05:54:10.741Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVQTPBFXQE12ZGYAHNYVGT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:54:10.740" grpc.time_ms=0.49 pid=925 span.kind=server system=grpc2118gitlab # [ 376.877053] gitaly[925]: time="2026-08-20T05:54:10.793Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVQTPBFXQE12ZGYAHNYVGT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3895 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:54:10.793" grpc.time_ms=0.525 pid=925 span.kind=server system=grpc2119gitlab # [ 376.924237] gitaly[925]: time="2026-08-20T05:54:10.840Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVQTPBFXQE12ZGYAHNYVGT grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:54:10.839" grpc.time_ms=0.576 pid=925 span.kind=server system=grpc2120gitlab # [ 376.954096] gitaly[925]: time="2026-08-20T05:54:10.850Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQTPBFXQE12ZGYAHNYVGT diskcache=2d760789-f5a8-44e7-93d0-4b064406be9b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:54:40.291" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:54:10.692" pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2121gitlab # [ 376.976489] gitaly[925]: time="2026-08-20T05:54:10.851Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=161 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7412 command.oublock=0 command.real_time_ms=151 command.spawn_token_fork_ms=3 command.system_time_ms=95 command.user_time_ms=66 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQTPBFXQE12ZGYAHNYVGT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:54:40.291" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:54:10.692" grpc.time_ms=158.181 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2122gitlab # [ 377.114214] gitaly[925]: time="2026-08-20T05:54:11.030Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQTPBFXQE12ZGYAHNYVGT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T05:54:41.027" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:11.028" grpc.time_ms=1.81 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2123gitlab # [ 377.171620] gitaly[925]: time="2026-08-20T05:54:11.088Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQTPBFXQE12ZGYAHNYVGT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:54:41.085" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:11.086" grpc.time_ms=1.432 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2124gitlab # [ 377.210856] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:11.104Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"4ba37eac94861b27144d1549","created_at":"2026-08-20T05:54:10.163Z","trace_propagation_headers":{"sentry-trace":"d77c64a7b3064917a83d66b4492ff887-79709875a57d4f60","baggage":"sentry-trace_id=d77c64a7b3064917a83d66b4492ff887,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVQTPBFXQE12ZGYAHNYVGT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:10.178Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2156,"job_status":"rescheduled","message":"PipelineProcessWorker JID-4ba37eac94861b27144d1549: rescheduled"}2125gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d/statuses2126gitlab # [ 377.559899] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:11.474Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"4ba37eac94861b27144d1549","created_at":"2026-08-20T05:54:10.163Z","trace_propagation_headers":{"sentry-trace":"d77c64a7b3064917a83d66b4492ff887-79709875a57d4f60","baggage":"sentry-trace_id=d77c64a7b3064917a83d66b4492ff887,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVQTPBFXQE12ZGYAHNYVGT","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:10.178Z","job_size_bytes":3,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-4ba37eac94861b27144d1549: done: 0.960091 sec","job_status":"done","queue_duration_s":0.335924,"scheduling_latency_s":0.335953,"gitaly_calls":3,"gitaly_duration_s":0.173255,"redis_calls":93,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.128224,"redis_read_bytes":169,"redis_write_bytes":22817,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001483,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001689,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":22,"redis_feature_flag_duration_s":0.008959,"redis_feature_flag_read_bytes":22,"redis_feature_flag_write_bytes":3871,"redis_queues_calls":22,"redis_queues_duration_s":0.006132,"redis_queues_read_bytes":25,"redis_queues_write_bytes":12384,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.102586,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000428,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000959,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004505,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":850,"db_count":43,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":43,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.076,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":27,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.039,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.041,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.041,"db_ci_duration_s":0.035,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.344503,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.55089314,"duration_s":0.960091,"completed_at":"2026-08-20T05:54:11.473Z","load_balancing_strategy":"primary","db_duration_s":0.084102,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2127gitlab # [ 377.616079] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:11.486Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"a8a13c947032b83012cc9244","created_at":"2026-08-20T05:54:10.411Z","trace_propagation_headers":{"sentry-trace":"7c557ae3e56f49c6be0291bf9433b0ca-067cbd6d16154118","baggage":"sentry-trace_id=7c557ae3e56f49c6be0291bf9433b0ca,sentry-release=Unknown"},"correlation_id":"01M0EVQTKTWA5RWQ8BYDJ54V8Q","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:10.413Z","job_size_bytes":3,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-a8a13c947032b83012cc9244: start","job_status":"start","queue_duration_s":1.072863,"scheduling_latency_s":1.07292}2128gitlab # [ 377.698355] gitaly[925]: time="2026-08-20T05:54:11.614Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQWDYX71EG5D3J2SFHQJA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:54:41.412" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:11.613" grpc.time_ms=1.136 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2129gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d/statuses, in 0.22 seconds)2130gitlab # [ 377.749570] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/08/20:05:54:11 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1462131gitlab # [ 377.789117] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:11.702Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"a8a13c947032b83012cc9244","created_at":"2026-08-20T05:54:10.411Z","trace_propagation_headers":{"sentry-trace":"7c557ae3e56f49c6be0291bf9433b0ca-067cbd6d16154118","baggage":"sentry-trace_id=7c557ae3e56f49c6be0291bf9433b0ca,sentry-release=Unknown"},"correlation_id":"01M0EVQTKTWA5RWQ8BYDJ54V8Q","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:10.413Z","job_size_bytes":3,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-a8a13c947032b83012cc9244: done: 0.215503 sec","job_status":"done","queue_duration_s":1.072863,"scheduling_latency_s":1.07292,"redis_calls":7,"redis_duration_s":0.059375000000000004,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.056689,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002686,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.05,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.026,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.084266,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.215503,"completed_at":"2026-08-20T05:54:11.701Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.04968,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2132gitlab # [ 377.884211] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:11.715Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"057b51a8292eb904c52392b6","created_at":"2026-08-20T05:54:10.653Z","trace_propagation_headers":{"sentry-trace":"d77c64a7b3064917a83d66b4492ff887-1c634f19f08a4fff","baggage":"sentry-trace_id=d77c64a7b3064917a83d66b4492ff887,sentry-release=Unknown"},"correlation_id":"01M0EVQTPBFXQE12ZGYAHNYVGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:10.665Z","job_size_bytes":23,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-057b51a8292eb904c52392b6: start","job_status":"start","queue_duration_s":1.049539,"scheduling_latency_s":1.049602}2133gitlab # [ 378.292950] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:12.206Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"057b51a8292eb904c52392b6","created_at":"2026-08-20T05:54:10.653Z","trace_propagation_headers":{"sentry-trace":"d77c64a7b3064917a83d66b4492ff887-1c634f19f08a4fff","baggage":"sentry-trace_id=d77c64a7b3064917a83d66b4492ff887,sentry-release=Unknown"},"correlation_id":"01M0EVQTPBFXQE12ZGYAHNYVGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:10.665Z","job_size_bytes":23,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-057b51a8292eb904c52392b6: done: 0.491012 sec","job_status":"done","queue_duration_s":1.049539,"scheduling_latency_s":1.049602,"redis_calls":19,"redis_duration_s":0.051342,"redis_read_bytes":17,"redis_write_bytes":3683,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.021972,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":967,"redis_queues_calls":2,"redis_queues_duration_s":0.001516,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1626,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.01799,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":742,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.006246,"redis_rate_limiting_write_bytes":148,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003618,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":18,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":18,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.091,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.017,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.017,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.075,"db_ci_duration_s":0.016,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.280078,"worker_id":"sidekiq_0","rate_limiting_gates":["permanent_email_failure","temporary_email_failure"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00383824,"duration_s":0.491012,"completed_at":"2026-08-20T05:54:12.205Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.10302,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2134gitlab # [ 378.394400] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:12.220Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"793ee35da08340c71ee9bcd0","created_at":"2026-08-20T05:54:10.862Z","trace_propagation_headers":{"sentry-trace":"d77c64a7b3064917a83d66b4492ff887-1c634f19f08a4fff","baggage":"sentry-trace_id=d77c64a7b3064917a83d66b4492ff887,sentry-release=Unknown"},"correlation_id":"01M0EVQTPBFXQE12ZGYAHNYVGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:10.875Z","job_size_bytes":3,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-793ee35da08340c71ee9bcd0: start","job_status":"start","queue_duration_s":1.344838,"scheduling_latency_s":1.344899}2135gitlab # [ 378.512509] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:12.427Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"793ee35da08340c71ee9bcd0","created_at":"2026-08-20T05:54:10.862Z","trace_propagation_headers":{"sentry-trace":"d77c64a7b3064917a83d66b4492ff887-1c634f19f08a4fff","baggage":"sentry-trace_id=d77c64a7b3064917a83d66b4492ff887,sentry-release=Unknown"},"correlation_id":"01M0EVQTPBFXQE12ZGYAHNYVGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:10.875Z","job_size_bytes":3,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-793ee35da08340c71ee9bcd0: done: 0.206979 sec","job_status":"done","queue_duration_s":1.344838,"scheduling_latency_s":1.344899,"redis_calls":10,"redis_duration_s":0.024567000000000002,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002617,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.013239,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.008711,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.023,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.077811,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00367454,"duration_s":0.206979,"completed_at":"2026-08-20T05:54:12.427Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.028661,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2136gitlab # [ 378.611000] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:12.440Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"f772baa20d16623d7d88e203","created_at":"2026-08-20T05:54:10.904Z","trace_propagation_headers":{"sentry-trace":"d77c64a7b3064917a83d66b4492ff887-1c634f19f08a4fff","baggage":"sentry-trace_id=d77c64a7b3064917a83d66b4492ff887,sentry-release=Unknown"},"correlation_id":"01M0EVQTPBFXQE12ZGYAHNYVGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:10.916Z","job_size_bytes":3,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-f772baa20d16623d7d88e203: start","job_status":"start","queue_duration_s":1.523915,"scheduling_latency_s":1.523973}2137gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d/statuses2138gitlab # [ 378.745053] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:12.660Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"f772baa20d16623d7d88e203","created_at":"2026-08-20T05:54:10.904Z","trace_propagation_headers":{"sentry-trace":"d77c64a7b3064917a83d66b4492ff887-1c634f19f08a4fff","baggage":"sentry-trace_id=d77c64a7b3064917a83d66b4492ff887,sentry-release=Unknown"},"correlation_id":"01M0EVQTPBFXQE12ZGYAHNYVGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:10.916Z","job_size_bytes":3,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-f772baa20d16623d7d88e203: done: 0.219601 sec","job_status":"done","queue_duration_s":1.523915,"scheduling_latency_s":1.523973,"redis_calls":10,"redis_duration_s":0.028971,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.006102,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.018273,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004596,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.033,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.028,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.087669,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00387578,"duration_s":0.219601,"completed_at":"2026-08-20T05:54:12.659Z","load_balancing_strategy":"primary","db_duration_s":0.032265,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2139gitlab # [ 378.844009] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:12.675Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"234e81e9f08bcedcd3c34bb8","created_at":"2026-08-20T05:54:10.944Z","trace_propagation_headers":{"sentry-trace":"d77c64a7b3064917a83d66b4492ff887-1c634f19f08a4fff","baggage":"sentry-trace_id=d77c64a7b3064917a83d66b4492ff887,sentry-release=Unknown"},"correlation_id":"01M0EVQTPBFXQE12ZGYAHNYVGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:10.954Z","job_size_bytes":3,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-234e81e9f08bcedcd3c34bb8: start","job_status":"start","queue_duration_s":1.720769,"scheduling_latency_s":1.720834}2140gitlab # [ 378.957947] gitaly[925]: time="2026-08-20T05:54:12.873Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQXM5MA0RMB1RM75BVF1B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:54:42.170" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:12.871" grpc.time_ms=1.269 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2141gitlab # [ 379.025599] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/08/20:05:54:12 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1992142gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d/statuses, in 0.28 seconds)2143gitlab # [ 379.082572] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:12.997Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"234e81e9f08bcedcd3c34bb8","created_at":"2026-08-20T05:54:10.944Z","trace_propagation_headers":{"sentry-trace":"d77c64a7b3064917a83d66b4492ff887-1c634f19f08a4fff","baggage":"sentry-trace_id=d77c64a7b3064917a83d66b4492ff887,sentry-release=Unknown"},"correlation_id":"01M0EVQTPBFXQE12ZGYAHNYVGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:10.954Z","job_size_bytes":3,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-234e81e9f08bcedcd3c34bb8: done: 0.322227 sec","job_status":"done","queue_duration_s":1.720769,"scheduling_latency_s":1.720834,"redis_calls":13,"redis_duration_s":0.076917,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003407,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.028862,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.017633,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.027015,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.093,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.032,"db_ci_duration_s":0.062,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.085894,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00527202,"duration_s":0.322227,"completed_at":"2026-08-20T05:54:12.997Z","load_balancing_strategy":"primary","db_duration_s":0.093106,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2144gitlab # [ 379.169218] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:13.010Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"7d610a173cb0afca19e05beb","created_at":"2026-08-20T05:54:12.135Z","trace_propagation_headers":{"sentry-trace":"d77c64a7b3064917a83d66b4492ff887-20a500d258434ae1","baggage":"sentry-trace_id=d77c64a7b3064917a83d66b4492ff887,sentry-release=Unknown"},"correlation_id":"01M0EVQTPBFXQE12ZGYAHNYVGT","meta.caller_id":"PipelineNotificationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:108aff161582131b4109ef0ef66900d868f023a787ce3ac6d8f1ad8cd88a7449","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:12.162Z","job_size_bytes":464,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-7d610a173cb0afca19e05beb: start","job_status":"start","queue_duration_s":0.848625,"scheduling_latency_s":0.84868}2145gitlab # [ 379.342618] sidekiq-cluster[2156]: {"severity":"WARN","time":"2026-08-20T05:54:13.254Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"7d610a173cb0afca19e05beb","created_at":"2026-08-20T05:54:12.135Z","trace_propagation_headers":{"sentry-trace":"d77c64a7b3064917a83d66b4492ff887-20a500d258434ae1","baggage":"sentry-trace_id=d77c64a7b3064917a83d66b4492ff887,sentry-release=Unknown"},"correlation_id":"01M0EVQTPBFXQE12ZGYAHNYVGT","meta.caller_id":"PipelineNotificationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:108aff161582131b4109ef0ef66900d868f023a787ce3ac6d8f1ad8cd88a7449","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:12.162Z","job_size_bytes":464,"pid":2156,"sidekiq_tid":"m7lw","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-7d610a173cb0afca19e05beb: fail: 0.241842 sec","job_status":"fail","queue_duration_s":0.848625,"scheduling_latency_s":0.84868,"redis_calls":9,"redis_duration_s":0.022452,"redis_read_bytes":8,"redis_write_bytes":1136,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00621,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.01351,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":585,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002732,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.035,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.031,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.109328,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00371794,"duration_s":0.241842,"completed_at":"2026-08-20T05:54:13.252Z","load_balancing_strategy":"primary_no_wal","exception.class":"ArgumentError","exception.message":":arguments expected to be an Array of individual string args","exception.backtrace":["/nix/store/rrv9bm690ckpz77hha6n0n51mxsbvqx4-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/network/delivery_methods/sendmail.rb:53:in `initialize'","/nix/store/rrv9bm690ckpz77hha6n0n51mxsbvqx4-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `new'","/nix/store/rrv9bm690ckpz77hha6n0n51mxsbvqx4-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `delivery_method'","/nix/store/cz6brp742c27105rzibf0cby8fip4mbx-ruby3.3-actionmailer-7.2.3.1/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3.1/lib/action_mailer/delivery_methods.rb:66:in `wrap_delivery_behavior'","/nix/store/cz6brp742c27105rzibf0cby8fip4mbx-ruby3.3-actionmailer-7.2.3.1/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3.1/lib/action_mailer/delivery_methods.rb:80:in `wrap_delivery_behavior!'","/nix/store/cz6brp742c27105rzibf0cby8fip4mbx-ruby3.3-actionmailer-7.2.3.1/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3.1/lib/action_mailer/base.rb:876:in `mail'","app/mailers/application_mailer.rb:85:in `block in mail_with_locale'","lib/gitlab/i18n.rb:116:in `with_locale'","app/mailers/application_mailer.rb:84:in `mail_with_locale'","app/mailers/notify.rb:293:in `email_with_layout'","app/mailers/emails/pipelines.rb:33:in `pipeline_mail'","app/mailers/emails/pipelines.rb:10:in `pipeline_failed_email'","/nix/store/m9ycl8lc459vif4hwf55sjn7qaar7l7i-ruby3.3-actionpack-7.2.3.1/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3.1/lib/abstract_controller/base.rb:215:in `process_action'","/nix/store/m9ycl8lc459vif4hwf55sjn7qaar7l7i-ruby3.3-actionpack-7.2.3.1/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3.1/lib/abstract_controller/callbacks.rb:261:in `block in process_action'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","lib/gitlab/i18n.rb:116:in `with_locale'","lib/gitlab/i18n.rb:126:in `with_default_locale'","app/mailers/application_mailer.rb:60:in `render_with_default_locale'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/m9ycl8lc459vif4hwf55sjn7qaar7l7i-ruby3.3-actionpack-7.2.3.1/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3.1/lib/abstract_controller/callbacks.rb:260:in `process_action'","/nix/store/m9ycl8lc459vif4hwf55sjn7qaar7l7i-ruby3.3-actionpack-7.2.3.1/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3.1/lib/abstract_controller/base.rb:152:in `process'","/nix/store/cz6brp742c27105rzibf0cby8fip4mbx-ruby3.3-actionmailer-7.2.3.1/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3.1/lib/action_mailer/rescuable.rb:29:in `block in process'","/nix/store/cz6brp742c27105rzibf0cby8fip4mbx-ruby3.3-actionmailer-7.2.3.1/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3.1/lib/action_mailer/rescuable.rb:21:in `handle_exceptions'","/nix/store/cz6brp742c27105rzibf0cby8fip4mbx-ruby3.3-actionmailer-7.2.3.1/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3.1/lib/action_mailer/rescuable.rb:28:in `process'","/nix/store/26xsw4aa1hlr5dffsy03i1p25i3sj6nh-ruby3.3-actionview-7.2.3.1/lib/ruby/gems/3.3.0/gems/actionview-7.2.3.1/lib/action_view/rendering.rb:40:in `process'","/nix/store/cz6brp742c27105rzibf0cby8fip4mbx-ruby3.3-actionmailer-7.2.3.1/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3.1/lib/action_mailer/base.rb:652:in `block in process'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/cz6brp742c27105rzibf0cby8fip4mbx-ruby3.3-actionmailer-7.2.3.1/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3.1/lib/action_mailer/base.rb:651:in `process'","/nix/store/cz6brp742c27105rzibf0cby8fip4mbx-ruby3.3-actionmailer-7.2.3.1/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3.1/lib/action_mailer/message_delivery.rb:136:in `block in processed_mailer'","\u003cinternal:kernel\u003e:90:in `tap'","/nix/store/cz6brp742c27105rzibf0cby8fip4mbx-ruby3.3-actionmailer-7.2.3.1/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3.1/lib/action_mailer/message_delivery.rb:135:in `processed_mailer'","/nix/store/cz6brp742c27105rzibf0cby8fip4mbx-ruby3.3-actionmailer-7.2.3.1/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3.1/lib/action_mailer/message_delivery.rb:124:in `deliver_now'","/nix/store/cz6brp742c27105rzibf0cby8fip4mbx-ruby3.3-actionmailer-7.2.3.1/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3.1/lib/action_mailer/mail_delivery_job.rb:28:in `perform'","/nix/store/qd6n9i9h7fabj0hg0y981sxvbgpnhrgx-ruby3.3-activejob-7.2.3.1/lib/ruby/gems/3.3.0/gems/activejob-7.2.3.1/lib/active_job/execution.rb:68:in `block in _perform_job'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/xcga4rn1mfaph6kv3z5dky53n4ix38q7-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/railtie.rb:32:in `block (2 levels) in insert_into_active_job'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/z1b9x0igifidmk4a5aq176krxshr4j2p-ruby3.3-i18n-1.14.8/lib/ruby/gems/3.3.0/gems/i18n-1.14.8/lib/i18n.rb:354:in `with_locale'","/nix/store/qd6n9i9h7fabj0hg0y981sxvbgpnhrgx-ruby3.3-activejob-7.2.3.1/lib/ruby/gems/3.3.0/gems/activejob-7.2.3.1/lib/active_job/translation.rb:9:in `block (2 levels) in \u003cmodule:Translation\u003e'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/core_ext/time/zones.rb:65:in `use_zone'","/nix/store/qd6n9i9h7fabj0hg0y981sxvbgpnhrgx-ruby3.3-activejob-7.2.3.1/lib/ruby/gems/3.3.0/gems/activejob-7.2.3.1/lib/active_job/timezones.rb:9:in `block (2 levels) in \u003cmodule:Timezones\u003e'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/qd6n9i9h7fabj0hg0y981sxvbgpnhrgx-ruby3.3-activejob-7.2.3.1/lib/ruby/gems/3.3.0/gems/activejob-7.2.3.1/lib/active_job/execution.rb:67:in `_perform_job'","/nix/store/qd6n9i9h7fabj0hg0y981sxvbgpnhrgx-ruby3.3-activejob-7.2.3.1/lib/ruby/gems/3.3.0/gems/activejob-7.2.3.1/lib/active_job/instrumentation.rb:32:in `_perform_job'","/nix/store/qd6n9i9h7fabj0hg0y981sxvbgpnhrgx-ruby3.3-activejob-7.2.3.1/lib/ruby/gems/3.3.0/gems/activejob-7.2.3.1/lib/active_job/execution.rb:51:in `perform_now'","/nix/store/qd6n9i9h7fabj0hg0y981sxvbgpnhrgx-ruby3.3-activejob-7.2.3.1/lib/ruby/gems/3.3.0/gems/activejob-7.2.3.1/lib/active_job/instrumentation.rb:26:in `block in perform_now'","/nix/store/zm4016ybvgvxwp38ki20jl1q8y9nk0vp-ruby3.3-activerecord-7.2.3.1/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3.1/lib/active_record/railties/job_runtime.rb:13:in `block in instrument'","/nix/store/qd6n9i9h7fabj0hg0y981sxvbgpnhrgx-ruby3.3-activejob-7.2.3.1/lib/ruby/gems/3.3.0/gems/activejob-7.2.3.1/lib/active_job/instrumentation.rb:40:in `block in instrument'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/qd6n9i9h7fabj0hg0y981sxvbgpnhrgx-ruby3.3-activejob-7.2.3.1/lib/ruby/gems/3.3.0/gems/activejob-7.2.3.1/lib/active_job/instrumentation.rb:39:in `instrument'","/nix/store/zm4016ybvgvxwp38ki20jl1q8y9nk0vp-ruby3.3-activerecord-7.2.3.1/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3.1/lib/active_record/railties/job_runtime.rb:11:in `instrument'","/nix/store/qd6n9i9h7fabj0hg0y981sxvbgpnhrgx-ruby3.3-activejob-7.2.3.1/lib/ruby/gems/3.3.0/gems/activejob-7.2.3.1/lib/active_job/instrumentation.rb:26:in `perform_now'","/nix/store/qd6n9i9h7fabj0hg0y981sxvbgpnhrgx-ruby3.3-activejob-7.2.3.1/lib/ruby/gems/3.3.0/gems/activejob-7.2.3.1/lib/active_job/logging.rb:32:in `block in perform_now'","/nix/store/qd6n9i9h7fabj0hg0y981sxvbgpnhrgx-ruby3.3-activejob-7.2.3.1/lib/ruby/gems/3.3.0/gems/activejob-7.2.3.1/lib/active_job/logging.rb:41:in `tag_logger'","/nix/store/qd6n9i9h7fabj0hg0y981sxvbgpnhrgx-ruby3.3-activejob-7.2.3.1/lib/ruby/gems/3.3.0/gems/activejob-7.2.3.1/lib/active_job/logging.rb:32:in `perform_now'","/nix/store/3j1v9jjaf4mfhwwdkc5skmmh8srsn03g-ruby3.3-sentry-rails-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-rails-5.23.0/lib/sentry/rails/active_job.rb:8:in `perform_now'","/nix/store/qd6n9i9h7fabj0hg0y981sxvbgpnhrgx-ruby3.3-activejob-7.2.3.1/lib/ruby/gems/3.3.0/gems/activejob-7.2.3.1/lib/active_job/execution.rb:29:in `block in execute'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/qd6n9i9h7fabj0hg0y981sxvbgpnhrgx-ruby3.3-activejob-7.2.3.1/lib/ruby/gems/3.3.0/gems/activejob-7.2.3.1/lib/active_job/railtie.rb:79:in `block (4 levels) in \u003cclass:Railtie\u003e'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/execution_wrapper.rb:87:in `wrap'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/qd6n9i9h7fabj0hg0y981sxvbgpnhrgx-ruby3.3-activejob-7.2.3.1/lib/ruby/gems/3.3.0/gems/activejob-7.2.3.1/lib/active_job/railtie.rb:78:in `block (3 levels) in \u003cclass:Railtie\u003e'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/qd6n9i9h7fabj0hg0y981sxvbgpnhrgx-ruby3.3-activejob-7.2.3.1/lib/ruby/gems/3.3.0/gems/activejob-7.2.3.1/lib/active_job/execution.rb:27:in `execute'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:13:in `perform'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:220:in `execute_job'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:185:in `block (4 levels) in process'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/current_organization/server.rb:21:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/identity/restore.rb:12:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/resource_usage_limit/middleware.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/resource_usage_limit/server.rb:8:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/database/load_balancing/sidekiq_server_middleware.rb:35:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/skip_jobs.rb:51:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/throttling/middleware.rb:18:in `perform'","lib/gitlab/sidekiq_middleware/throttling/server.rb:8:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/pause_control/strategies/base.rb:31:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/strategy_handler.rb:22:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/server.rb:8:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/duplicate_jobs/strategies/until_executing.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/duplicate_job.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/server.rb:8:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/concurrency_limit/middleware.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/concurrency_limit/server.rb:8:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/click_house/migration_support/sidekiq_middleware.rb:7:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/worker_context.rb:9:in `wrap_in_optional_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:19:in `block in call'","lib/gitlab/application_context.rb:185:in `block in use'","/nix/store/bksfq00iiyqq3wq07f2jg2i534qz2n4v-ruby3.3-gitlab-labkit-2.0.0/lib/ruby/gems/3.3.0/gems/gitlab-labkit-2.0.0/lib/labkit/context.rb:43:in `with_context'","lib/gitlab/application_context.rb:185:in `use'","lib/gitlab/application_context.rb:105:in `with_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:17:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_status/server_middleware.rb:7:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_versioning/middleware.rb:9:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `block in call'","lib/gitlab/database/query_analyzer.rb:94:in `within'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/admin_mode/server.rb:14:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/set_ip_address.rb:7:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/instrumentation_logger.rb:10:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/batch_loader.rb:7:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/extra_done_log_metadata.rb:7:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/server_metrics.rb:112:in `block in call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `block in instrument'","lib/gitlab/metrics/background_transaction.rb:33:in `run'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `instrument'","lib/gitlab/sidekiq_middleware/server_metrics.rb:111:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:8:in `block in call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:66:in `enabling_request_store'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:59:in `ensure_request_store'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:7:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/bksfq00iiyqq3wq07f2jg2i534qz2n4v-ruby3.3-gitlab-labkit-2.0.0/lib/ruby/gems/3.3.0/gems/gitlab-labkit-2.0.0/lib/labkit/middleware/sidekiq/server.rb:22:in `block in call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/bksfq00iiyqq3wq07f2jg2i534qz2n4v-ruby3.3-gitlab-labkit-2.0.0/lib/ruby/gems/3.3.0/gems/gitlab-labkit-2.0.0/lib/labkit/middleware/sidekiq/user_experience_sli/server.rb:16:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/bksfq00iiyqq3wq07f2jg2i534qz2n4v-ruby3.3-gitlab-labkit-2.0.0/lib/ruby/gems/3.3.0/gems/gitlab-labkit-2.0.0/lib/labkit/middleware/sidekiq/context/server.rb:16:in `block in call'","/nix/store/bksfq00iiyqq3wq07f2jg2i534qz2n4v-ruby3.3-gitlab-labkit-2.0.0/lib/ruby/gems/3.3.0/gems/gitlab-labkit-2.0.0/lib/labkit/context.rb:43:in `with_context'","/nix/store/bksfq00iiyqq3wq07f2jg2i534qz2n4v-ruby3.3-gitlab-labkit-2.0.0/lib/ruby/gems/3.3.0/gems/gitlab-labkit-2.0.0/lib/labkit/middleware/sidekiq/context/server.rb:15:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/bksfq00iiyqq3wq07f2jg2i534qz2n4v-ruby3.3-gitlab-labkit-2.0.0/lib/ruby/gems/3.3.0/gems/gitlab-labkit-2.0.0/lib/labkit/middleware/sidekiq/server.rb:21:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/monitor.rb:10:in `block in call'","lib/gitlab/sidekiq_daemon/monitor.rb:46:in `within_job'","lib/gitlab/sidekiq_middleware/monitor.rb:9:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:10:in `block in call'","lib/gitlab/sidekiq_sharding/validator.rb:42:in `enabled'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:9:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/size_limiter/server.rb:13:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/xcga4rn1mfaph6kv3z5dky53n4ix38q7-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/sidekiq_instrumentation.rb:9:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/057zb68nv365hwg6mvz9k9jkqc8h5ki3-ruby3.3-sentry-sidekiq-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-sidekiq-5.23.0/lib/sentry/sidekiq/sentry_context_middleware.rb:54:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job/interrupt_handler.rb:9:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:26:in `track'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:134:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:184:in `block (3 levels) in process'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:145:in `block (6 levels) in dispatch'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:118:in `local'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:144:in `block (5 levels) in dispatch'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:27:in `block in call'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/execution_wrapper.rb:91:in `wrap'","/nix/store/s2iywasdn86kaphww0h4xgxwzcffj74y-ruby3.3-activesupport-7.2.3.1/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3.1/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:26:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:139:in `block (4 levels) in dispatch'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:281:in `stats'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:134:in `block (3 levels) in dispatch'","lib/gitlab/sidekiq_logging/structured_logger.rb:21:in `call'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:133:in `block (2 levels) in dispatch'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:85:in `global'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:132:in `block in dispatch'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_logger.rb:40:in `prepare'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:131:in `dispatch'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:183:in `block (2 levels) in process'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `handle_interrupt'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `block in process'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `handle_interrupt'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `process'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:86:in `process_one'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:76:in `run'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:10:in `watchdog'","/nix/store/rl7bk89r8fq3ldn4y7pdrq6xhf9wcsfb-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:19:in `block in safe_thread'"],"db_duration_s":0.046392,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2146gitlab # [ 379.804368] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:13.277Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"660350d79c1846477b2cce5d","created_at":"2026-08-20T05:54:10.956Z","trace_propagation_headers":{"sentry-trace":"d77c64a7b3064917a83d66b4492ff887-1c634f19f08a4fff","baggage":"sentry-trace_id=d77c64a7b3064917a83d66b4492ff887,sentry-release=Unknown"},"correlation_id":"01M0EVQTPBFXQE12ZGYAHNYVGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:10.966Z","job_size_bytes":3,"pid":2156,"sidekiq_tid":"mk2s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-660350d79c1846477b2cce5d: start","job_status":"start","queue_duration_s":2.311112,"scheduling_latency_s":2.311167}2147gitlab # [ 379.821103] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:13.482Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"660350d79c1846477b2cce5d","created_at":"2026-08-20T05:54:10.956Z","trace_propagation_headers":{"sentry-trace":"d77c64a7b3064917a83d66b4492ff887-1c634f19f08a4fff","baggage":"sentry-trace_id=d77c64a7b3064917a83d66b4492ff887,sentry-release=Unknown"},"correlation_id":"01M0EVQTPBFXQE12ZGYAHNYVGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:10.966Z","job_size_bytes":3,"pid":2156,"sidekiq_tid":"mk2s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-660350d79c1846477b2cce5d: done: 0.204991 sec","job_status":"done","queue_duration_s":2.311112,"scheduling_latency_s":2.311167,"redis_calls":10,"redis_duration_s":0.026889,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.006415,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.014334,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00614,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.036,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.023,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.079619,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00478634,"duration_s":0.204991,"completed_at":"2026-08-20T05:54:13.481Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.035319,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2148gitlab # [ 379.866412] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:13.495Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"bb572d05fd135ef2aa2be669","created_at":"2026-08-20T05:54:10.967Z","trace_propagation_headers":{"sentry-trace":"d77c64a7b3064917a83d66b4492ff887-1c634f19f08a4fff","baggage":"sentry-trace_id=d77c64a7b3064917a83d66b4492ff887,sentry-release=Unknown"},"correlation_id":"01M0EVQTPBFXQE12ZGYAHNYVGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:10.976Z","job_size_bytes":19,"pid":2156,"sidekiq_tid":"mk2s","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-bb572d05fd135ef2aa2be669: start","job_status":"start","queue_duration_s":2.519501,"scheduling_latency_s":2.519556}2149gitlab # [ 379.883227] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:13.681Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"bb572d05fd135ef2aa2be669","created_at":"2026-08-20T05:54:10.967Z","trace_propagation_headers":{"sentry-trace":"d77c64a7b3064917a83d66b4492ff887-1c634f19f08a4fff","baggage":"sentry-trace_id=d77c64a7b3064917a83d66b4492ff887,sentry-release=Unknown"},"correlation_id":"01M0EVQTPBFXQE12ZGYAHNYVGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:10.976Z","job_size_bytes":19,"pid":2156,"sidekiq_tid":"mk2s","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-bb572d05fd135ef2aa2be669: done: 0.185637 sec","job_status":"done","queue_duration_s":2.519501,"scheduling_latency_s":2.519556,"redis_calls":11,"redis_duration_s":0.029401,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002436,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.022433,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004532,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.068041,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00237508,"duration_s":0.185637,"completed_at":"2026-08-20T05:54:13.681Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.022646,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2150gitlab # [ 379.929681] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:13.695Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"failed\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"dd5c7ea4fc69ed8ab1666e05","created_at":"2026-08-20T05:54:10.982Z","trace_propagation_headers":{"sentry-trace":"d77c64a7b3064917a83d66b4492ff887-1c634f19f08a4fff","baggage":"sentry-trace_id=d77c64a7b3064917a83d66b4492ff887,sentry-release=Unknown"},"correlation_id":"01M0EVQTPBFXQE12ZGYAHNYVGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e2e8f76273ed3dffe93170e4a8828cd9c1cde36f18ce9deaf751670cff2f2dad","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:10.990Z","job_size_bytes":65,"pid":2156,"sidekiq_tid":"mk2s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-dd5c7ea4fc69ed8ab1666e05: start","job_status":"start","queue_duration_s":2.705498,"scheduling_latency_s":2.705554}2151gitlab # [ 379.985446] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:13.899Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"failed\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"dd5c7ea4fc69ed8ab1666e05","created_at":"2026-08-20T05:54:10.982Z","trace_propagation_headers":{"sentry-trace":"d77c64a7b3064917a83d66b4492ff887-1c634f19f08a4fff","baggage":"sentry-trace_id=d77c64a7b3064917a83d66b4492ff887,sentry-release=Unknown"},"correlation_id":"01M0EVQTPBFXQE12ZGYAHNYVGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e2e8f76273ed3dffe93170e4a8828cd9c1cde36f18ce9deaf751670cff2f2dad","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:10.990Z","job_size_bytes":65,"pid":2156,"sidekiq_tid":"mk2s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-dd5c7ea4fc69ed8ab1666e05: done: 0.203656 sec","job_status":"done","queue_duration_s":2.705498,"scheduling_latency_s":2.705554,"redis_calls":10,"redis_duration_s":0.031466,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.007343,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.018943,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00518,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.024,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.081939,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00376234,"duration_s":0.203656,"completed_at":"2026-08-20T05:54:13.899Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.032427,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2152gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d/statuses2153gitlab # [ 380.035828] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:13.912Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"4ed297345f64cb62eadc85bd","created_at":"2026-08-20T05:54:10.991Z","trace_propagation_headers":{"sentry-trace":"d77c64a7b3064917a83d66b4492ff887-1c634f19f08a4fff","baggage":"sentry-trace_id=d77c64a7b3064917a83d66b4492ff887,sentry-release=Unknown"},"correlation_id":"01M0EVQTPBFXQE12ZGYAHNYVGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:10.995Z","job_size_bytes":3,"pid":2156,"sidekiq_tid":"mk2s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-4ed297345f64cb62eadc85bd: start","job_status":"start","queue_duration_s":2.917065,"scheduling_latency_s":2.917116}2154gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d/statuses, in 0.24 seconds)2155gitlab # [ 380.211398] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:14.126Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"4ed297345f64cb62eadc85bd","created_at":"2026-08-20T05:54:10.991Z","trace_propagation_headers":{"sentry-trace":"d77c64a7b3064917a83d66b4492ff887-1c634f19f08a4fff","baggage":"sentry-trace_id=d77c64a7b3064917a83d66b4492ff887,sentry-release=Unknown"},"correlation_id":"01M0EVQTPBFXQE12ZGYAHNYVGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:10.995Z","job_size_bytes":3,"pid":2156,"sidekiq_tid":"mk2s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-4ed297345f64cb62eadc85bd: done: 0.21416 sec","job_status":"done","queue_duration_s":2.917065,"scheduling_latency_s":2.917116,"redis_calls":7,"redis_duration_s":0.016263,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.0135,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002763,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.056,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.037,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.077846,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.21416,"completed_at":"2026-08-20T05:54:14.126Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.055598,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2156gitlab # [ 380.296785] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:14.136Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"847b33fe0157d1e84ba7ed5a","created_at":"2026-08-20T05:54:10.999Z","trace_propagation_headers":{"sentry-trace":"d77c64a7b3064917a83d66b4492ff887-1c634f19f08a4fff","baggage":"sentry-trace_id=d77c64a7b3064917a83d66b4492ff887,sentry-release=Unknown"},"correlation_id":"01M0EVQTPBFXQE12ZGYAHNYVGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:11.006Z","job_size_bytes":3,"pid":2156,"sidekiq_tid":"mk2s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-847b33fe0157d1e84ba7ed5a: start","job_status":"start","queue_duration_s":3.129691,"scheduling_latency_s":3.129747}2157gitlab # [ 380.322417] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/08/20:05:54:14 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 1652158gitlab # [ 380.326881] gitaly[925]: time="2026-08-20T05:54:14.131Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQYW8QEVNZRYBHWRPJ0S7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:54:44.129" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:14.129" grpc.time_ms=1.296 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2159gitlab # [ 380.462563] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:14.377Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"847b33fe0157d1e84ba7ed5a","created_at":"2026-08-20T05:54:10.999Z","trace_propagation_headers":{"sentry-trace":"d77c64a7b3064917a83d66b4492ff887-1c634f19f08a4fff","baggage":"sentry-trace_id=d77c64a7b3064917a83d66b4492ff887,sentry-release=Unknown"},"correlation_id":"01M0EVQTPBFXQE12ZGYAHNYVGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:11.006Z","job_size_bytes":3,"pid":2156,"sidekiq_tid":"mk2s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-847b33fe0157d1e84ba7ed5a: done: 0.241727 sec","job_status":"done","queue_duration_s":3.129691,"scheduling_latency_s":3.129747,"redis_calls":10,"redis_duration_s":0.06507,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.019092,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.040424,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005554,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.033,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.025,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.071931,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00177118,"duration_s":0.241727,"completed_at":"2026-08-20T05:54:14.377Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.049653,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2160gitlab # [ 380.567844] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:14.391Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"ed50ee5da65c92cdb2e8383b","created_at":"2026-08-20T05:54:11.007Z","trace_propagation_headers":{"sentry-trace":"d77c64a7b3064917a83d66b4492ff887-1c634f19f08a4fff","baggage":"sentry-trace_id=d77c64a7b3064917a83d66b4492ff887,sentry-release=Unknown"},"correlation_id":"01M0EVQTPBFXQE12ZGYAHNYVGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:11.013Z","job_size_bytes":6,"pid":2156,"sidekiq_tid":"mk2s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-ed50ee5da65c92cdb2e8383b: start","job_status":"start","queue_duration_s":3.37739,"scheduling_latency_s":3.377443}2161gitlab # [ 380.599413] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:14.514Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"ed50ee5da65c92cdb2e8383b","created_at":"2026-08-20T05:54:11.007Z","trace_propagation_headers":{"sentry-trace":"d77c64a7b3064917a83d66b4492ff887-1c634f19f08a4fff","baggage":"sentry-trace_id=d77c64a7b3064917a83d66b4492ff887,sentry-release=Unknown"},"correlation_id":"01M0EVQTPBFXQE12ZGYAHNYVGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:11.013Z","job_size_bytes":6,"pid":2156,"sidekiq_tid":"mk2s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-ed50ee5da65c92cdb2e8383b: done: 0.123499 sec","job_status":"done","queue_duration_s":3.37739,"scheduling_latency_s":3.377443,"redis_calls":10,"redis_duration_s":0.023297,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004221,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.012551,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.006525,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045666,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00346702,"duration_s":0.123499,"completed_at":"2026-08-20T05:54:14.514Z","load_balancing_strategy":"primary","db_duration_s":0.015331,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2162gitlab # [ 380.665251] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:14.525Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"4083f80c0e6903e3c70467bb","created_at":"2026-08-20T05:54:11.104Z","trace_propagation_headers":{"sentry-trace":"d77c64a7b3064917a83d66b4492ff887-1c634f19f08a4fff","baggage":"sentry-trace_id=d77c64a7b3064917a83d66b4492ff887,sentry-release=Unknown"},"correlation_id":"01M0EVQTPBFXQE12ZGYAHNYVGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:11.107Z","job_size_bytes":3,"pid":2156,"sidekiq_tid":"mk2s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-4083f80c0e6903e3c70467bb: start","job_status":"start","queue_duration_s":3.41774,"scheduling_latency_s":3.417789}2163gitlab # [ 380.770505] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:14.685Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"4083f80c0e6903e3c70467bb","created_at":"2026-08-20T05:54:11.104Z","trace_propagation_headers":{"sentry-trace":"d77c64a7b3064917a83d66b4492ff887-1c634f19f08a4fff","baggage":"sentry-trace_id=d77c64a7b3064917a83d66b4492ff887,sentry-release=Unknown"},"correlation_id":"01M0EVQTPBFXQE12ZGYAHNYVGT","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:11.107Z","job_size_bytes":3,"pid":2156,"sidekiq_tid":"mk2s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-4083f80c0e6903e3c70467bb: done: 0.160374 sec","job_status":"done","queue_duration_s":3.41774,"scheduling_latency_s":3.417789,"redis_calls":8,"redis_duration_s":0.018799,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.01433,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004469,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.019,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048216,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.160374,"completed_at":"2026-08-20T05:54:14.685Z","load_balancing_strategy":"primary","db_duration_s":0.023433,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2164gitlab # [ 380.994585] gitaly[925]: time="2026-08-20T05:54:14.911Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQZNE5KDV833W8PF0F28S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:54:44.208" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:14.909" grpc.time_ms=1.099 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2165gitlab # [ 381.086997] gitaly[925]: time="2026-08-20T05:54:15.003Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=0 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQZNE5KDV833W8PF0F28S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:54:24.142" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:54:14.992" grpc.time_ms=10.217 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2166gitlab # [ 381.175201] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:15.086Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"8b4b03d75e26cd024b50a3c0","created_at":"2026-08-20T05:54:15.067Z","trace_propagation_headers":{"sentry-trace":"636c31034fff499bb4b2c44f100ef56c-26f1a2ba77c24e88","baggage":"sentry-trace_id=636c31034fff499bb4b2c44f100ef56c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVQZNE5KDV833W8PF0F28S","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:15.074Z","job_size_bytes":3,"pid":2156,"sidekiq_tid":"mk2s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-8b4b03d75e26cd024b50a3c0: start","job_status":"start","queue_duration_s":0.011439,"scheduling_latency_s":0.011492}2167gitlab # [ 381.220783] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/08/20:05:54:15 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 2732168gitlab # [ 381.227123] nixbot[3752]: {"ts": "2026-08-20T05:54:15.107Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d \"HTTP/1.1 201 Created\""}2169gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d/statuses2170gitlab # [ 381.308411] gitaly[925]: time="2026-08-20T05:54:15.224Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQZYB3PA397NPJA8NSBZG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:54:45.021" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:15.222" grpc.time_ms=2.184 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2171gitlab # [ 381.410970] gitaly[925]: time="2026-08-20T05:54:15.324Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQZYB3PA397NPJA8NSBZG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:54:25.298" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:54:15.309" grpc.time_ms=14.447 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2172gitlab # [ 381.434659] gitaly[925]: time="2026-08-20T05:54:15.351Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVR02R8DRT0MSDHAR77DDA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:54:45.347" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:15.347" grpc.time_ms=3.002 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2173gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d/statuses, in 0.20 seconds)2174gitlab # [ 381.477735] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/08/20:05:54:15 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d/statuses HTTP/1.1" 200 671 "" "curl/8.21.0" 1342175gitlab # [ 381.538428] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/08/20:05:54:15 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 3382176gitlab # [ 381.545283] nixbot[3752]: {"ts": "2026-08-20T05:54:15.456Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d \"HTTP/1.1 201 Created\""}2177gitlab # [ 381.588666] gitaly[925]: time="2026-08-20T05:54:15.505Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVQZNE5KDV833W8PF0F28S grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:54:15.504" grpc.time_ms=0.843 pid=925 span.kind=server system=grpc2178gitlab # [ 381.621033] gitaly[925]: time="2026-08-20T05:54:15.537Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVR09DHEKEXBXJJDDJ3G1E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:54:45.535" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:15.535" grpc.time_ms=0.937 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2179gitlab # [ 381.649149] gitaly[925]: time="2026-08-20T05:54:15.560Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVQZNE5KDV833W8PF0F28S grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3895 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:54:15.560" grpc.time_ms=0.573 pid=925 span.kind=server system=grpc2180gitlab # [ 381.670782] gitaly[925]: time="2026-08-20T05:54:15.587Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=5 command.system_time_ms=0 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M0EVR09DHEKEXBXJJDDJ3G1E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:54:25.015" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:54:15.575" grpc.time_ms=11.597 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2181gitlab # [ 381.693889] gitaly[925]: time="2026-08-20T05:54:15.609Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EVQZNE5KDV833W8PF0F28S grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:54:15.608" grpc.time_ms=1.277 pid=925 span.kind=server system=grpc2182gitlab # [ 381.709080] gitaly[925]: time="2026-08-20T05:54:15.619Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQZNE5KDV833W8PF0F28S diskcache=5f0e2f60-24e3-49f8-a0dd-beb60c58f7fe grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:54:45.041" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:54:15.442" pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2183gitlab # [ 381.723549] gitaly[925]: time="2026-08-20T05:54:15.619Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=129 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7092 command.oublock=0 command.real_time_ms=169 command.spawn_token_fork_ms=1 command.system_time_ms=65 command.user_time_ms=64 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQZNE5KDV833W8PF0F28S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T05:54:45.041" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:54:15.442" grpc.time_ms=176.883 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2184gitlab # [ 381.742796] nixbot[3752]: {"ts": "2026-08-20T05:54:15.658Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d \"HTTP/1.1 201 Created\""}2185gitlab # [ 381.746631] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/08/20:05:54:15 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 1912186gitlab # [ 381.836383] nix-daemon[4046]: accepted connection from pid 4322, user nixbot2187gitlab # [ 381.898348] gitaly[925]: time="2026-08-20T05:54:15.814Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVQZNE5KDV833W8PF0F28S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T05:54:45.413" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:15.813" grpc.time_ms=0.972 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2188gitlab # [ 381.981470] gitaly[925]: time="2026-08-20T05:54:15.897Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EVR0M14P2CFKJVDZHVCCEG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:54:15.887" grpc.time_ms=10.406 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc2189gitlab # [ 382.015221] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/08/20:05:54:15 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 882190gitlab # [ 382.025789] gitaly[925]: time="2026-08-20T05:54:15.942Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVQZNE5KDV833W8PF0F28S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:54:45.540" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:15.941" grpc.time_ms=0.945 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2191gitlab # [ 382.072067] gitaly[925]: time="2026-08-20T05:54:15.988Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EVR0PXRXBF7NGA2Z44XKHD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:54:15.978" pid=925 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2192gitlab # [ 382.092276] gitaly[925]: time="2026-08-20T05:54:15.988Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVR0PXRXBF7NGA2Z44XKHD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:54:15.978" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc2193gitlab # [ 382.112550] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:15.996Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"bb20ee5cb31e66e2ebd2be15","created_at":"2026-08-20T05:54:15.981Z","trace_propagation_headers":{"sentry-trace":"636c31034fff499bb4b2c44f100ef56c-87af664f8f754e32","baggage":"sentry-trace_id=636c31034fff499bb4b2c44f100ef56c,sentry-release=Unknown"},"correlation_id":"01M0EVQZNE5KDV833W8PF0F28S","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"8b4b03d75e26cd024b50a3c0","job_size_bytes":3,"pid":2156,"job_status":"deduplicated","message":"PipelineProcessWorker JID-bb20ee5cb31e66e2ebd2be15: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2194gitlab # [ 382.131692] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:16.011Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"8b4b03d75e26cd024b50a3c0","created_at":"2026-08-20T05:54:15.067Z","trace_propagation_headers":{"sentry-trace":"636c31034fff499bb4b2c44f100ef56c-26f1a2ba77c24e88","baggage":"sentry-trace_id=636c31034fff499bb4b2c44f100ef56c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVQZNE5KDV833W8PF0F28S","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:15.074Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2156,"job_status":"rescheduled","message":"PipelineProcessWorker JID-8b4b03d75e26cd024b50a3c0: rescheduled"}2195gitlab # [ 382.148193] gitlab-workhorse[823]: time="2026-08-20T05:54:15Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672196gitlab # [ 382.150999] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/08/20:05:54:15 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 872197gitlab # [ 382.152954] gitaly[925]: time="2026-08-20T05:54:15.989Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVR0PXRXBF7NGA2Z44XKHD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:54:15.978" grpc.time_ms=10.298 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc2198gitlab # [ 382.167621] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:16.043Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"8b4b03d75e26cd024b50a3c0","created_at":"2026-08-20T05:54:15.067Z","trace_propagation_headers":{"sentry-trace":"636c31034fff499bb4b2c44f100ef56c-26f1a2ba77c24e88","baggage":"sentry-trace_id=636c31034fff499bb4b2c44f100ef56c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EVQZNE5KDV833W8PF0F28S","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:15.074Z","job_size_bytes":3,"pid":2156,"sidekiq_tid":"mk2s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-8b4b03d75e26cd024b50a3c0: done: 0.957496 sec","job_status":"done","queue_duration_s":0.011439,"scheduling_latency_s":0.011492,"gitaly_calls":3,"gitaly_duration_s":0.21998,"redis_calls":88,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.120742,"redis_read_bytes":250,"redis_write_bytes":24187,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.008704,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.025532,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.009349,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1083,"redis_queues_calls":27,"redis_queues_duration_s":0.020719,"redis_queues_read_bytes":31,"redis_queues_write_bytes":15581,"redis_queues_metadata_calls":24,"redis_queues_metadata_duration_s":0.041268,"redis_queues_metadata_read_bytes":114,"redis_queues_metadata_write_bytes":3962,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000282,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000331,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.005853,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":36,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.181,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":19,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.019,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.024,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.106,"db_ci_duration_s":0.075,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.303685,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.69861028,"duration_s":0.957496,"completed_at":"2026-08-20T05:54:16.043Z","load_balancing_strategy":"primary","db_duration_s":0.196898,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2199gitlab # [ 382.226057] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:16.051Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"5dbd9c7bcdd15b7e2e5771b7","created_at":"2026-08-20T05:54:15.411Z","trace_propagation_headers":{"sentry-trace":"636c31034fff499bb4b2c44f100ef56c-87af664f8f754e32","baggage":"sentry-trace_id=636c31034fff499bb4b2c44f100ef56c,sentry-release=Unknown"},"correlation_id":"01M0EVQZNE5KDV833W8PF0F28S","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:15.420Z","job_size_bytes":23,"pid":2156,"sidekiq_tid":"mk2s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-5dbd9c7bcdd15b7e2e5771b7: start","job_status":"start","queue_duration_s":0.630248,"scheduling_latency_s":0.630299}2200gitlab # [ 382.243060] nix-daemon[4046]: accepted connection from pid 4347, user nixbot2201gitlab # [ 382.339989] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:16.255Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"5dbd9c7bcdd15b7e2e5771b7","created_at":"2026-08-20T05:54:15.411Z","trace_propagation_headers":{"sentry-trace":"636c31034fff499bb4b2c44f100ef56c-87af664f8f754e32","baggage":"sentry-trace_id=636c31034fff499bb4b2c44f100ef56c,sentry-release=Unknown"},"correlation_id":"01M0EVQZNE5KDV833W8PF0F28S","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:15.420Z","job_size_bytes":23,"pid":2156,"sidekiq_tid":"mk2s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-5dbd9c7bcdd15b7e2e5771b7: done: 0.20414 sec","job_status":"done","queue_duration_s":0.630248,"scheduling_latency_s":0.630299,"redis_calls":7,"redis_duration_s":0.016980000000000002,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.012843,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004137,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.059,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.035,"db_ci_duration_s":0.024,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.084083,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.20414,"completed_at":"2026-08-20T05:54:16.255Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.058946,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2202gitlab # [ 382.429778] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:16.269Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"b39df93058b0052b050ea7c7","created_at":"2026-08-20T05:54:15.633Z","trace_propagation_headers":{"sentry-trace":"636c31034fff499bb4b2c44f100ef56c-87af664f8f754e32","baggage":"sentry-trace_id=636c31034fff499bb4b2c44f100ef56c,sentry-release=Unknown"},"correlation_id":"01M0EVQZNE5KDV833W8PF0F28S","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:15.638Z","job_size_bytes":3,"pid":2156,"sidekiq_tid":"mk2s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-b39df93058b0052b050ea7c7: start","job_status":"start","queue_duration_s":0.631335,"scheduling_latency_s":0.631401}2203gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d/statuses2204gitlab # [ 382.506871] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:16.421Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"b39df93058b0052b050ea7c7","created_at":"2026-08-20T05:54:15.633Z","trace_propagation_headers":{"sentry-trace":"636c31034fff499bb4b2c44f100ef56c-87af664f8f754e32","baggage":"sentry-trace_id=636c31034fff499bb4b2c44f100ef56c,sentry-release=Unknown"},"correlation_id":"01M0EVQZNE5KDV833W8PF0F28S","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:15.638Z","job_size_bytes":3,"pid":2156,"sidekiq_tid":"mk2s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-b39df93058b0052b050ea7c7: done: 0.15229 sec","job_status":"done","queue_duration_s":0.631335,"scheduling_latency_s":0.631401,"redis_calls":7,"redis_duration_s":0.015063,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.012573,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00249,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.019,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0608,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.15229,"completed_at":"2026-08-20T05:54:16.421Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018827,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2205gitlab # [ 382.595955] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:16.511Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"d298271fe5f273c6c7eca43b","created_at":"2026-08-20T05:54:15.650Z","trace_propagation_headers":{"sentry-trace":"636c31034fff499bb4b2c44f100ef56c-87af664f8f754e32","baggage":"sentry-trace_id=636c31034fff499bb4b2c44f100ef56c,sentry-release=Unknown"},"correlation_id":"01M0EVQZNE5KDV833W8PF0F28S","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:15.656Z","job_size_bytes":3,"pid":2156,"sidekiq_tid":"mk2s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-d298271fe5f273c6c7eca43b: start","job_status":"start","queue_duration_s":0.855661,"scheduling_latency_s":0.855721}2206gitlab # [ 382.643050] gitaly[925]: time="2026-08-20T05:54:16.558Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EVR18DBN94SNF5E81PM53T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:54:46.356" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:54:16.557" grpc.time_ms=1.046 pid=925 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2207gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d/statuses, in 0.25 seconds)2208(finished: subtest: eval and build post commit statuses, in 6.43 seconds)2209(finished: run the VM test script, in 451.09 seconds)2210gitlab # [ 382.679329] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:16.594Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"d298271fe5f273c6c7eca43b","created_at":"2026-08-20T05:54:15.650Z","trace_propagation_headers":{"sentry-trace":"636c31034fff499bb4b2c44f100ef56c-87af664f8f754e32","baggage":"sentry-trace_id=636c31034fff499bb4b2c44f100ef56c,sentry-release=Unknown"},"correlation_id":"01M0EVQZNE5KDV833W8PF0F28S","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a438d79f5f5ba6d4ef2b849979aa33f2bcd0b8b093a7892d92863b57e28035e2","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:15.656Z","job_size_bytes":3,"pid":2156,"sidekiq_tid":"mk2s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-d298271fe5f273c6c7eca43b: done: 0.083097 sec","job_status":"done","queue_duration_s":0.855661,"scheduling_latency_s":0.855721,"redis_calls":7,"redis_duration_s":0.003694,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002583,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001111,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.060704,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.083097,"completed_at":"2026-08-20T05:54:16.594Z","load_balancing_strategy":"primary","db_duration_s":0.011353,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2211gitlab # [ 382.754128] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:16.599Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"dbc28b4325c9095b3ce9409e","created_at":"2026-08-20T05:54:15.673Z","trace_propagation_headers":{"sentry-trace":"636c31034fff499bb4b2c44f100ef56c-87af664f8f754e32","baggage":"sentry-trace_id=636c31034fff499bb4b2c44f100ef56c,sentry-release=Unknown"},"correlation_id":"01M0EVQZNE5KDV833W8PF0F28S","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:15.680Z","job_size_bytes":3,"pid":2156,"sidekiq_tid":"mk2s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-dbc28b4325c9095b3ce9409e: start","job_status":"start","queue_duration_s":0.918058,"scheduling_latency_s":0.918112}2212gitlab # [ 382.774165] gitlab-workhorse[823]: gitlab 2001:db8:1::1 - - [2026/08/20:05:54:16 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d/statuses HTTP/1.1" 200 1328 "" "curl/8.21.0" 1482213gitlab # [ 382.778585] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:16.689Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::TestFailureHistoryWorker","jid":"dbc28b4325c9095b3ce9409e","created_at":"2026-08-20T05:54:15.673Z","trace_propagation_headers":{"sentry-trace":"636c31034fff499bb4b2c44f100ef56c-87af664f8f754e32","baggage":"sentry-trace_id=636c31034fff499bb4b2c44f100ef56c,sentry-release=Unknown"},"correlation_id":"01M0EVQZNE5KDV833W8PF0F28S","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:721e749fe77618a4212007bc934d77ea6bfb5f3b79a2b9e7613972c1099ff3d2","size_limiter":"validated","enqueued_at":"2026-08-20T05:54:15.680Z","job_size_bytes":3,"pid":2156,"sidekiq_tid":"mk2s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-dbc28b4325c9095b3ce9409e: done: 0.090162 sec","job_status":"done","queue_duration_s":0.918058,"scheduling_latency_s":0.918112,"redis_calls":10,"redis_duration_s":0.005268999999999999,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003057,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001353,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000859,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.064921,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.090162,"completed_at":"2026-08-20T05:54:16.688Z","load_balancing_strategy":"primary","db_duration_s":0.011211,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2214test script finished in 451.20s2215cleanup2216kill QemuMachine (pid 46)2217gitlab # [ 382.830611] sidekiq-cluster[2156]: {"severity":"INFO","time":"2026-08-20T05:54:16.692Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"6100cb85d8c2b080c4e30b34","created_at":"2026-08-20T05:54:15.683Z","trace_propagation_headers":{"sentry-trace":"636c31034fff499bb4b2c44f100ef56c-87af664f8f754e32",qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/41m77i1296n33p6liin8ynr6wh3h6b7m-python3-3.14.6/bin/python3.14)2218(finished: cleanup, in 1.53 seconds)2219additionally exposed symbols:2220 gitlab,2221 vlan1,2222 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh2223[]2224[{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-08-20T05:54:03.283Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]2225[]2226[]2227[]2228[]2229[{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': 'b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-08-20T05:54:09.630564Z', 'started_at': '2026-08-20T05:54:10.200329Z', 'finished_at': None}]2230[{'id': 2, 'sha': 'b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-20T05:54:10.165Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2231[{'id': 2, 'sha': 'b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-20T05:54:10.165Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2232[{'id': 2, 'sha': 'b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-20T05:54:10.165Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2233[{'id': 2, 'sha': 'b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-20T05:54:10.165Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2234[{'id': 2, 'sha': 'b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-08-20T05:54:10.165Z', 'started_at': None, 'finished_at': '2026-08-20T05:54:15.050Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2235[{'id': 2, 'sha': 'b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-08-20T05:54:10.165Z', 'started_at': None, 'finished_at': '2026-08-20T05:54:15.050Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 4, 'sha': 'b67f62f9ea4a2cac30d1f2d74e5ee1e7a695152d', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '0 attributes built', 'created_at': '2026-08-20T05:54:15.404Z', 'started_at': None, 'finished_at': '2026-08-20T05:54:15.611Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]